Those favored ethnicities were also those closest to the existing elites' desired American culture, which kinda makes the point: they felt the more dissimilar ethnicities couldn't be absorbed at their existing immigration rate.