MartinB comments on Scientific Self-Help: The State of Our Knowledge - Less Wrong

138 Post author: lukeprog 20 January 2011 08:44PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (493)

You are viewing a single comment's thread. Show more comments above.

Comment author: MartinB 22 January 2011 03:45:17PM 1 point [-]

I think I see different requirements for things working that for things not working.

People getting actively angry about something looks like a (weak) indicator that they are afraid there might be something to it. They do not get angry at 9/11 conspiracists, but laugh about them. They do get angry at the other party.

If you have someone trying to do something and be unsuccessful that tells you even less. I would not see it as indicator of not working. It is just no particular evidence.

But maybe I have the notion of what 'weak' means wrong.

Comment author: shokwave 22 January 2011 04:20:33PM 1 point [-]

If you have someone trying to do something and be unsuccessful that tells you even less. I would not see it as indicator of not working. It is just no particular evidence.

It almost has to be evidence; even if it's just evidence that the person isn't doing it right, then you push this case through your prior for how often they do things wrong. Unless your prior is very high, you're still getting half the impact or more of the evidence. Although you could argue from the selection effect of "correct in your expectations of success" that you're almost guaranteed to only notice cases where they are doing it wrong, not cases where it doesn't work (because you don't expect it to work where it won't).