RobinZ comments on Even if you have a nail, not all hammers are the same - Less Wrong

95 Post author: PhilGoetz 29 March 2010 06:09PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (125)

You are viewing a single comment's thread. Show more comments above.

Comment author: Rain 30 March 2010 02:47:29PM *  3 points [-]

The way traditional rationalists without special training relate to scientific findings is usually by accepting them as authoritative. One can become less wrong by learning that scientists are not close to perfect.

"Trust experts except when you don't"?

Trust no one. Learn a little math.

"Don't trust experts; become one yourself"? Wouldn't that put me in the category of people-not-to-be-trusted? Isn't that what Phil is pointing out, that most people don't understand statistics? Why would I expect myself to be better at judging these kinds of problems than experts who spend their lives on it? Should I not expect myself to be just as bad at it, and potentially much worse (know enough to be dangerous)?

Did you understand the math in this post?

Yes. But it seems fundamental enough that experts should have caught it, therefore I am skeptical.

Comment author: RobinZ 30 March 2010 03:34:21PM *  4 points [-]

Yes. But it seems fundamental enough that experts should have caught it, therefore I am skeptical.

Some questions (this is an obviously incomplete* list, of course) to ask when you are in this situation:

  1. Is the source pointing out the error reliable?

  2. Does the criticized work acknowledge or otherwise address the claim?

  3. Does the criticized work contain other flaws? (Subcategory: is the criticized work sloppy or lazy in execution?)

In this particular case, the answer to the third question appears to be "yes". This is probably good reason to raise your probability that this particular criticism is correct.

* Bear in mind, of course, Eliezer Yudkowsky's warning: If you want to shoot your foot off, it is never the least bit difficult to do so.

Comment author: Rain 01 April 2010 05:09:02PM 1 point [-]

Thank you. These steps for analysis are very useful to me, and I feel they answer my original questions.