These days most Ivy League schools are easy to graduate if one doesn't pick a hard major, so that really means "conditioned on 'was admitted into an Ivy League college' ". Except Ivy League colleges practice affirmative action, so it's still evidence in the original direction.
Even with affirmative action, it's still harder to get into Ivy League schools as a minority than as a white person. You need more talent to get in than the white guy you're competing with.
Suppose I told you that I knew for a fact that the following statements were true:
You’d think I was crazy, right?
Now suppose it were the year 1901, and you had to choose between believing those statements I have just offered, and believing statements like the following:
Based on a comment of Robin Hanson’s: “I wonder if one could describe in enough detail a fictional story of an alternative reality, a reality that our ancestors could not distinguish from the truth, in order to make it very clear how surprising the truth turned out to be.”1
1Source: http://lesswrong.com/lw/j0/making_history_available/ewg.