SoullessAutomaton comments on Accuracy Versus Winning - Less Wrong

12 Post author: John_Maxwell_IV 02 April 2009 04:47AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (72)

You are viewing a single comment's thread. Show more comments above.

Comment author: SoullessAutomaton 02 April 2009 08:50:27PM *  5 points [-]

My recollection is that at least one study showed some regression to the mean in confidence -- highly-skilled people tended to underestimate themselves.

To the best of my knowledge, this sort of effect is mostly not an effect of underestimation, but rather of either misestimating the skills of others, and/or of restricting the group against which one evaluates oneself.

Generally, it seems, if one has no knowledge of others' skills in an area, an estimation of one's own skill level is likely wildly inaccurate; if one's knowledge of others' skills is biased in favor of a non-random group, one's own skill is likely closer to the mean of that group than expected.

That is to say, if you're better at X than your friends are, you're probably not as good as you think; if you're jealous of your friends' skill at X you're probably better than you think. On the other hand, if you measure your success against the best and brightest in a field, you're probably wildly underestimating yourself; but if you're proud of being good at something and compare yourself to random people you meet you're probably substantially overestimating yourself.

People posting on LW are strongly self-selected in favor of rationality, so anyone reading this is probably closer to average within this community than they think they are!

Comment author: ciphergoth 04 April 2009 12:42:57PM 4 points [-]

Drivers think they are comparing themselves to the other drivers they see on the road. In fact, they are comparing themselves to the drivers whose skill they have most cause to think about, which is overwhelmingly often the worst drivers on the road.

Comment author: SoullessAutomaton 04 April 2009 01:01:17PM 1 point [-]

Yes, this is the same principle of a biased relative estimate due to comparison against a non-random subset of others.

Comment author: Nick_Tarleton 04 April 2009 07:27:26AM 1 point [-]

This is great information. Do you have a link?

Comment author: SoullessAutomaton 04 April 2009 11:48:08AM 0 points [-]

Sadly, no; I have a poor memory for details and have not generally been in the habit of saving links to my sources, something I need to correct. Chances are it's actually a synthesis of multiple sources, all of which I read a year or more ago. Mea culpa.