I had the impression that the height/intelligence correlation was actually quite weak:

the correlation between height and intelligence is not that high. This association is probably not going to be intuitively visible to anyone, but rather only shows up in large data sets.

http://blogs.discovermagazine.com/gnxp/2013/04/why-are-taller-people-more-intelligent/#.UZsQvIpDsqg