CronoDAS comments on She Blinded Me With Science - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (38)
Normative language ("ought") is not helpful here. Journals that nominally require publication of data or calculations don't enforce it, either.
One way to deal with selection bias and fraud that I have occasionally seen, and only in economics and parapsychology ("the control group for science"), is to compare the effect size to the study size. If it's a real effect, it will not depend on the study size. But if it's fake, it will always just barely be statistically significant and thus it will decline with study size.
This kind of meta-analysis come from not trusting one's peers. This is rude, hence rare. But it's a lot more useful than pooling the data, the usual meta-analysis.
Excellent quote. May I steal it?
It's too good to ask permission for. I'll wait to get forgiveness ;).