PhilGoetz comments on Teachable Rationality Skills - Less Wrong

52 Post author: Eliezer_Yudkowsky 27 May 2011 09:57PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (257)

You are viewing a single comment's thread.

Comment author: PhilGoetz 30 May 2011 05:31:45PM *  25 points [-]

Rationality skill: Recognize rationality skill in others.

There is a strong tendency for people to use the heuristic, "P(Person X is right) = # of times person X has been observed to be right / # of statements person X has made", or worse, "(# statements by X - # of times X has admitted to making a mistake) / # statements by X".

This encourages people who want to be respected to do 4 bad things:

  • Make many pronouncements on things that are obviously right, perhaps in a manner suggesting they are controversial claims.
  • Avoid saying anything unless they are certain they are correct.
  • Avoid saying anything concrete enough to possibly be proven wrong.
  • Never, ever admit to having made a mistake.

Unfortunately, these methods are extremely effective.

Comment author: stcredzero 31 May 2011 11:51:31PM *  2 points [-]

Avoid saying anything unless they are certain they are correct.

I don't think this is a pernicious behavior at all. I suspect that this is actually a sign of rationality.

http://www.paulgraham.com/heroes.html (See Robert Morris)

Comment author: Nick_Tarleton 01 June 2011 12:17:24AM *  0 points [-]

It can easily be both; and, while not speaking unless very confident may not be terribly harmful by itself, the perfectionism that it's an example of is a very characteristic failure mode of rationalists.

Comment author: sgeek 02 June 2011 10:09:40PM 5 points [-]

I think the key here is qualification - Robert Morris avoided being wrong by not stating things unqualified unless he was sure of them, whereas the failure mode for rationalists is not expressing an idea at all unless fairly sure of it.

We want ideas to be shared before they're well-supported, because discussion is generally the best way for them to find support (or disproof) - we just need to signal the uncertainty when we introduce an idea.

It's much like what I've been taught in analytical chemistry - every number has a stated uncertainty associated with it.