EHeller comments on White Lies - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (893)
I didn't claim to. What I claim in what you quoted is that dragging in a concept like evidenced based medicine and climate science isn't going to help anything in a discussion of Bem's paper.
I would phrase this differently. Bem believes that an informal Bayesian filter (extraordinary claims require extraordinary evidence) is causing academic psychology to unfairly conclude that psi phenomena aren't real. He wants us to ignore the incredibly low prior for psi, and use weak but statistically significant effects to push us to "psi is probable."
I don't agree with this, as I've hopefully made clear.
Not necessarily true- a good Bayesian who has read the paper could conclude the methodology is flawed enough that its not much evidence of anything (which was also largely the academic psychology response). I believe the methodology of "Feeling the Future" was so flawed that it isn't evidence for anything. The replication attempts that failed further reinforce this belief.
Bem does not believe that most researchers really follow extraordinary claims require extraordinary evidence. He believes that many of the relevant researches won't be convinced regardles of what evidence is provided.
He might be wrong about that belief but saying that he believes that most researchers would be convinced be reasonable data misunderstands Bem.
Not much evidence and no evidence are two different things. If he believes it's evidence and you don't he's right. It might not be much evidence but it's evidence in the bayesian sense.
If you debate with him in person and pretend it's no evidence he will continue to say it's evidence and be right. That will prevent the discussion to come to the questions that actually matter of how strong the evidence happens to be.
At university we did a failed attempt to replicate PCR. It really made the postdoc who was running the experiement ashamed that she couldn't get it right and that it failed for some reason unknown to her. In no way does this concludes that PCR doesn't work.
As far as replication goes Bem also seems to think that there were successful replication attempts:
If you have a very strange effect that you don't understand and can't pin down having 2 of 6 replication attempts be successful does not really prove that there no effect. If something can go wrong and a method like PCR that's done millions of times fails to replicated without knowledgeable people knowing why, failing to replicate a very new effect doesn't mean much. Trying to pin down the difference between the 2 successful and the 4 failed replication attempts might be in order. At least that where I would focus my attention when I'm not attached to the outcome. It may very well turn out that there no real effect in the end but there seems to be more than nothing.
From the same interview of Bem I linked to above (but by the moderator):
Again that not that much different from the way Sokal sees the literature department.