Jonathan_Graehl comments on Existential Risk and Public Relations - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (613)
Good comment.
However,
This was hard to parse. I would have named "p-value" directly. My understanding is that a stated "p-value" will indeed depend on the number of observations, and that in practice meta-analyses pool the observations from many experiments. I agree that we should not use a hard p-value cutoff for publishing experimental results.
I should have said "a set of observations" and "sets of observations". I meant things like that if you and other groups test lots of slightly different bogus hypotheses 5% of them will be "confirmed" with statistically significant relations.
Got it, and agreed. This is one of the most pernicious forms of dishonesty by professional researchers (lying about how many hypotheses were generated), and is far more common than merely faking everything.