Vaniver comments on 2014 Survey Results - Less Wrong

87 Post author: Yvain 05 January 2015 07:36PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (279)

You are viewing a single comment's thread. Show more comments above.

Comment author: Gondolinian 04 January 2015 07:23:46PM 3 points [-]

SAT Scores out of 1600/SAT Scores out of 2400 .844 (59)

I'm surprised that this correlation wasn't higher. They're both pretty much the same test, right?

Three explanations I thought of:

  1. I'm missing something/I have an inaccurate model of the difference between the two tests.

  2. There's a lot of random difference between SAT scores from different testings. If this is true, I would expect there to be a correlation of around .844 between one test score and a later test score under the same grading system.

  3. SAT scores are correlated with age (no idea whether this is true or not) and people take the two tests some time apart, and thus have better scores on the second.

Any ideas?

Comment author: Vaniver 04 January 2015 07:53:42PM *  8 points [-]

Any ideas?

The psychometric term for #2 is test-retest reliability, and the numbers I've seen for the SAT range between .8 and .95, so I think that is a complete explanation for this phenomenon.

If the 2400 scores (which came later) are higher than the 1600 scores, that's evidence for #3, but comparing them is difficult because they do test different things and are normed differently.