taw comments on Sociosexual Orientation Inventory, or failing to perform basic sanity checks - Less Wrong

3 Post author: taw 16 September 2009 10:00AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (41)

You are viewing a single comment's thread. Show more comments above.

Comment author: taw 16 September 2009 04:20:54PM 1 point [-]

Shalizi's complaints are semi-valid, that if you throw a huge amount of somewhat correlated data at PCA, you will most likely get a small number of components, with one explaining most of the variance. And when you start removing data that doesn't correlate highly enough (as obviously "testing something else"), the leading component will only seem statistically stronger.

I'm quite surprised but it mirrors very closely what I think about the Big Five personality traits - factors on their own don't really prove anywhere as much as is commonly stated, and can as easily be statistical artifacts.

This criticism doesn't mean that either IQ or big 5 are invalid, but it does mean that the case should be made for them independently of "they show up as big factors in PCA". It seems to be so for IQ, and I'm not that terribly convinced it's also true for the Big Five.