qsz comments on How subjective is attractiveness? - LessWrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (38)
There's plenty of research on reliability of rating scales - and the sweet spot seems to be a range from 7-10 choices at least according to quite a few studies designed to address this directly. An influential paper in this regard is Preston & Coleman's (2000) "Optimal number of response categories in rating scales: reliability, validity, discriminating power, and respondent preferences." link to PDF
Abstract:
Or if one prefers a more analytic approach, here's a 2012 conference proceedings paper by Kluver et al "How many bits per rating?" link to PDF