This probably doesn't quite count, but how about Einstein's and Szilard's relatively low esteem among their peers and consequentially low influence largely due to relatively low math ability prior to their major successes (and in Szilard's case, even after his).

If Szilard had been more influential, nuclear weapons could have been developed early enough to radically change the course of WWII.