It doesn't quite have to be controlled by a single gene, I was giving an example. Something like height, which is affected by many factors, could be affected by lots of single gene substitutions, but you would expect the over-all effect to look like an averaging out, not like some humans having one set of decision making machinery and others having a totally different set.