lmm comments on Too good to be true - Less Wrong

24 Post author: PhilGoetz 11 July 2014 08:16PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (119)

You are viewing a single comment's thread.

Comment author: lmm 18 July 2014 08:44:49PM 3 points [-]

Vaguely interesting, but a p=.13 result in pretty much any field gets a big fat "meh" from me. Sometimes p=.13 results happen. I'd want stronger evidence before I started to suspect bias.

Comment author: gwern 19 July 2014 12:58:38AM 3 points [-]

Excess significance and publication bias in general are so common as to be the default; p=0.13 is pretty bad looking (with a single-tailed test, that'd be below the 0.10 threshold Ioannides suggest for publication bias tests due to their low power to detect bias).