alex_zag_al comments on The Statistician's Fallacy - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (67)
What does this mean?
If they need statistics to reach the truth, then undermining the statistics is a very big deal.
I can see only a few possibilities:
They really need statistics, but they are making random errors in their statistics and getting random results. The field is worthless.
They are reaching the correct conclusions through non-statistical scientific methods and the statistics is window-dressing. (or perhaps they real method is statistical, but much simpler and more robust than they claim)
They are reaching wrong conclusions through unspecified wrong methods and the statistics is window dressing. (How can you distinguish this from the previous?)
The leaders of the field do correct statistics and reach the correct conclusions. Everyone else copies their conclusions and messes up the statistics. It should be easy to find the leaders and check their statistics.
Five: They have mostly correct beliefs because they mostly do statistics correctly. This leads them to only test things with high prior probability, where they can screw up the statistics and still get the right answers. However, if they never did the statistics properly, they would drift away from these correct beliefs.