It isn't easy to identify people who are just modified to be in the upper end of normal human capacities.

People normally have parents. It's easy to say when the genes of the parents don't correspond to the genes of a child.

Apart from that I think you underrate the ease of doing genetic engineering without leaving traces. Especially with a decade between the moment of birth and the moment that someone analyses the DNA for traces of manipulation.