But then the difference in intelligence would be almost completely shared + nonshared environment. And twin studies suggest it's very inheritable. It also seems to be a polygenic trait, so there can be quite a lot of new mutations there that haven't yet reached fixation even if it's strongly selected for.