nyan_sandwich comments on The Universal Medical Journal Article Error - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (189)
Interesting. Those two statements seem quite different; more than just a rephrasing.
Probabilistically, it sounds like the study found
P(hyper|dye) = P(hyper|~dye), that is they rejectedP(hyper|dye) > P(hyper|~dye), and concludedP(hyper|dye) = P(hyper|~dye)(no connection) correctly.I think your logical interpretation of their result throws out most of the information. Yes they concluded that it is not true that all children that ate dye were hyperactive, but they also found that the proportion of dye-eaters who were hyperactive was not different from the base rate, which is a much stronger statement, which does imply their conclusion, but can't be captured by the logical formulation you gave.
You are making the same mistake by ignoring the quantification. The test used to reject P(hyper|dye) > P(hyper|~dye) uses a cutoff that is set from the sample size using the assumption that all the children have the identical response. They didn't find P(hyper|dye) = P(hyper|~dye), they rejected the hypothesis that for all children, P(hyper|dye) > P(hyper|~dye), and then inappropriately concluded that for all children, !P(hyper|dye) > P(hyper|~dye).