Unnamed comments on Funnel plots: the study that didn't bark, or, visualizing regression to the null - Less Wrong

47 Post author: gwern 04 December 2011 11:05AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (40)

You are viewing a single comment's thread.

Comment author: Unnamed 30 November 2011 07:59:48PM 5 points [-]

Y = chance there's a real correlation

The y-axis shows the effect size (the odds ratio in this sample), which is different from statistical significance (the probability that the relationship observed in this sample would occur purely by chance). This passage:

you would expect that the trials with small samples would have a wide scattering of results (sometimes they would look wildly significant and sometimes they would look wildly insignficant)

should also be written in terms of effect sizes, rather than statistical significance.

Comment author: gwern 30 November 2011 09:27:23PM 1 point [-]

Mm. I was aiming for ease of understanding, but maybe that just lead to it being more confusing. I've made your suggested edits.