Jack comments on Particles break light-speed limit? - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (170)
How is that?
You need to provide links because I read a fair bit on the subject and don't recall this. If I came across such results my money would be on fraud of systematic error- not a statistical fluke.
This is the kind of "outside-view-taken to the extreme" attitude that just doesn't make sense. We know why the statistical results of para-psychological studies tend to not be trustworthy- publication bias, file drawer effect, exploratory research turned into hypothesis testing retroactively etc. If we didn't know why such statistical results couldn't be trusted the we would be compelled to seriously consider para-psychological claims. My claim is that those reasons don't apply to neutrino velocity measurements.
That's a fair request. I don't really have the time to go digging for those details, though. If you feel so inspired, again I'd point to the work done at the Stanford Research Institute (or at least I think it was that) where they did a ridiculous number of trials of all kinds and did get several standard deviations away from the expected mean predicted based on the null hypothesis. I honestly don't remember the numbers at all, so you could be right that there has never been anything like a six-s.d. deviation in parapsychological experiments. I seem to recall that they got somewhere around ten - but it has been something like six years since I read anything on this topic.
That said, I get the feeling there's a bit of goalpost-moving going on in this discussion. In Eliezer's original reference to parapsychology as the control group for science, his point was that there are some amazingly subjective effects that come into play with frequentist statistics that could account for even the good (by frequentist standards) positive-result studies from parapsychology. I agree, there's a lot of problem with things like publication bias and the like, and that does offer an explanation for a decent chunk of parapsychology's material. But to quote Eliezer:
I haven't looked at the CERN group's methods in enough detail to know if they're making the same kind of error. I'm just trying to point out that we can't assign an abysmally low probability to their making a common kind of statistical error that finds a small-but-low-p-value effect without simultaneously assigning a lower probability to parapsychologists making this same mistake than Eliezer seems to.
And to be clear, I am not saying "Either the CERN group made statistical errors or telepathy exists." Nor am I trying to defend parapsychology. I'm simply pointing out that we have to be even-handed in our dismissal of low-p-value thinking.
That doesn't actually strike me as all that much extra improbability. A whole bunch of the mechanisms would allow both!