AnnaSalamon comments on Ask LW: What questions to test in our rationality questionnaire? - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (45)
If good looks aren't strongly correlated with the answers to other questions, we can use the responses of groups of test-takers to "how good-looking are you?" to see whether that group, in aggregate, tends to be positively self-deceived. It isn't definitive, but if e.g. the group of respondants whose questionnaires are low in a particular factor also have the property that 50% of them regard themselves as being in the best-looking 10% of the population, while for the group whose questionnaires are high in that factor, only 10% regard themselves as being in the best-looking 10%... that would be evidence (though not definitive evidence) that the factor correlates with accurate self-assessment.
Not sure whether this is feasible, but could you use the results of this sort of overoptimism calibration to adjust other subjective performance measures for bias? Maybe if you had more of these sorts of question in different domains, and overoptimism were strongly correlated across them all?