There are two big problems with standardized tests.
First, the standard tests are badly calibrated for measuring the high-performing tail of the distribution. Something like 6% of all GRE takers get a perfect score on the math portion. So GREs won't separate good from very good.
Second, aptitude for doing GRE-style or IQ-style math problems isn't known to be a close correlate for real ability. Universities are full of people with stellar test scores who don't ever amount to anything. On the other hand, Richard Feynman, who was very smart and very hard working, had a measured IQ of something like 125, which is not all that impressive as a test score.
125???! Sh*t, I've got to start working harder. (source?)
I intended Leveling Up in Rationality to communicate this:
But some people seem to have read it and heard this instead:
This failure (on my part) fits into a larger pattern of the Singularity Institute seeming too arrogant and (perhaps) being too arrogant. As one friend recently told me:
So, I have a few questions: