One more example of misapplied statistics. You see a 5-standard-deviation signal for faster-than-light neutrinos and reason like this:
"Well, prior to seeing these data I would rate the odds of neutrinos traveling FTL as, say, 1:1000, but this is full 5 standard deviations so the likelihood ratio is about 3.5 million for them going FTL after all, so I must revise my belief and now accept that those neutrinos travel FTL with ~3500:1 odds."
...which, of course, only happens because you have oversimplified by only considering two hypotheses. Whereas in reality you should also have thrown in some other possibilities, like e.g. some undiscovered flaw in the measurements. Which I would, prior to seeing the data, assign a higher probability, say, odds of 1:100 (a mere 1% probability of faulty experiment, just to be generous to the experimenters). Now after seeing the data we also have to revise this probability, and it comes out as ~35000:1 odds for faulty experimental design.
In other words, the more "statistically significant" is the result in such an experiment, the more it is evidence for faulty measurement and against the experimenters' claim (here, FTL neutrinos).
In other words, the more "statistically significant" is the result in such an experiment, the more it is evidence for faulty measurement and against the experimenters' claim (here, FTL neutrinos).
It's still evidence for the claims, just also evidence for the experiment being faulty.
A mundane cause for a surprising result. Consider this unconfirmed for now, however unsurprising it sounds.
Source: Science/AAAS