ChristianKl comments on Too good to be true - Less Wrong

24 Post author: PhilGoetz 11 July 2014 08:16PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (119)

You are viewing a single comment's thread. Show more comments above.

Comment author: DanielLC 21 July 2014 01:31:06AM 1 point [-]

Only if it's statistically significant. It could be a small enough effect that they don't notice unless they're looking for it (if you're going to publish a finding from either extreme, you're supposed to use a two-tailed test, so they'd presumably want something stronger than p = 0.05), but large enough to keep them from accidentally noticing the opposite effect.

Comment author: ChristianKl 21 July 2014 11:20:57AM 1 point [-]

Not all statistical analysis has to be preregistered. If a data has a trend that suggest vaccination might reduce autism I'm sure the researchers would run a test for it.

If the study is underpowered to find a effect in that direction it's also like to be underpowered to find a effect in the other direction.

Can someone with more statistical expertise run a test to see whether the studies are underpowered to pick up effects in either direction?