gjm comments on Practical rationality questionnaire - Less Wrong

15 Post author: AnnaSalamon 16 April 2009 11:21PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (27)

You are viewing a single comment's thread.

Comment author: gjm 17 April 2009 01:16:32AM 5 points [-]

There are questions asking us to compare ourselves with populations of other people about whom we are likely to have only limited and unreliable knowledge, to which the answers "about the same, so far as I know" and "of course I have no idea, you silly survey-author" are not available. I think this is unfortunate.

Comment author: AnnaSalamon 17 April 2009 01:21:47AM *  0 points [-]

Thanks for noting the difficulty. I'm not sure how to improve it, though. I want to know comparisons to people with "basically your starting-advantages" (e.g., not being born in rural Africa), but... when I tried to phrase things in that vicinity it became much more dependent on the survey respondant's interpretation (e.g., on whether they included IQ, or compared themselves to others with their neurological diagnosis).

Any suggestions?

Comment author: gjm 17 April 2009 02:03:26AM 2 points [-]

Well, you could at least give "about the same" and "no idea" as options.

In general, I worry that the questionnaire is going to have trouble disentangling variations in people's actual success and in their descriptions of their success. Of course this is very difficult to avoid.