I chose Ramanujan as my example because mathematics is extremely meritocratic, as proven by how he went from poor/middle-class Indian on the verge of starving to England on the strength of his correspondence & papers. If there really were countless such people, we would see many many examples of starving farmers banging out some impressive proofs and achieving levels of fame somewhat comparable to Einstein; hence the reference class of peasant-Einsteins must be very small since we see so few people using sheer brainpower to become famous like Ramanujan.

(Or we could simply point out that with average IQs in the 70s and 80s, average mathematician IQs closer to 140s - or 4 standard deviations away, even in a population of billions we still would only expect a small handful of Ramanujans - consistent with the evidence. Gould, of course, being a Marxist who denies any intelligence, would not agree.)