ChrisHallquist comments on The Statistician's Fallacy - Less Wrong

38 Post author: ChrisHallquist 09 December 2013 04:48AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (67)

You are viewing a single comment's thread. Show more comments above.

Comment author: ChrisHallquist 09 December 2013 04:59:42PM 3 points [-]

Links?

All the stuff I've found makes the epidemiological evidence sound inconclusive, but the arguments from physics / biology seem pretty solid. But I've also heard people suggest that descriptions of the epidemeological evidence sound inconclusive because what they really mean is "if there's an effect, it's too small to detect," which scientists are afraid to say because that would also be misinterpreted. I'd really like to get clearer on this.

Comment author: zslastman 10 December 2013 01:10:01PM *  4 points [-]

Querying my brain for specific sources turned up NULL, so I spent a couple of minutes on pubmed. It seems my statement was too confident.

There was a large metastudy which found some effect in a high quality subset of studies: http://www.ncbi.nlm.nih.gov/pubmed/19826127 And a commentary on it which says their definition of 'high quality' is bullshit, amongst other things: http://jco.ascopubs.org/content/28/7/e121.long

I find the criticisms in the commentary convincing, but I'd still rate their being a reasonable chance of an actual association existing, and therefore a non-negligible risk of an actual causal relationship as opposed to just some confound. I invite anyone who likes this sort of thing to give it a little more time.