Normal_Anomaly comments on The null model of science - Less Wrong

19 Post author: Johnicholas 26 March 2011 01:53PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (16)

You are viewing a single comment's thread.

Comment author: Normal_Anomaly 26 March 2011 04:59:26PM 1 point [-]

Good article, but scary.

One possible explanation is that for any given thing being investigated, there's some chance of an effect size initially larger than it should be, and some chance of it initially being smaller that it should be. If by chance the effect size starts out being too small, the investigation of the thing never takes off. If by chance the effect size starts out too large, a ton more studies are done and regression to the mean happens.

Alternately, it's possible that lots of initial studies have flawed methodology. Then, as more studies are done on a topic, the methodology becomes slowly more refined and the effect slowly goes away.