Less Wrong is a community blog devoted to refining the art of human rationality. Please visit our About page for more information.

Kurros comments on Lost Purposes - Less Wrong

68 Post author: Eliezer_Yudkowsky 25 November 2007 09:01AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (73)

Sort By: Old

You are viewing a single comment's thread. Show more comments above.

Comment author: Kurros 27 April 2014 01:03:56AM 2 points [-]

That sounds to me more like an argument for needing lower p-values, not higher ones. If there are many confounding factors, you need a higher threshold of evidence for claiming that you are seeing a real effect.

Physicists need low p-values for a different reason, namely that they do very large numbers of statistical tests. If you choose p=0.05 as your threshold then it means that you are going to be claiming a false detection at least one time in twenty (roughly speaking), so if physicists did this they would be claiming false detections every other day and their credibility would plummet like a rock.