"He is definitely elitist but I've never heard of him scoff at the idea of talent coming from poverty. "

Elitists often make a point of not scoffing at the idea of talent coming from poverty. When poor people attain great success, it helps to justify the elitist's belief that their own success had nothing to do with the privileges they had access to (i.e. comfortable living, proper nutrition, and good educational material).