You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

RichardKennaway comments on The Universal Medical Journal Article Error - Less Wrong Discussion

6 Post author: PhilGoetz 29 April 2014 05:57PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (189)

You are viewing a single comment's thread. Show more comments above.

Comment author: RichardKennaway 06 April 2013 07:09:48PM 7 points [-]

42% of the voters so far down-voted this piece, indicating that LessWrong readers perform slightly better than random at logic.

Are you intending the irony there?

BTW, it seems to me that your point is about an error of statistical inference, not first-order logic. Specifically, experimenters not noticing their assumption that the population is homogeneous. When the assumption is wrong, wrong inferences can follow. That is, inferences which correctly follow from the assumption and the experimental results, but which are nevertheless false.

Comment author: PhilGoetz 06 April 2013 08:39:40PM *  1 point [-]

No; the difference is that in your interpretation, we would say "wrong assumption, hence discard results." In my interpretation, if they had found a significant effect, they would have been able to correctly conclude that there was an effect; and finding no significant effect, they could have correctly concluded the negation of that.

I don't know what irony you refer to.

Comment author: RichardKennaway 06 April 2013 09:11:49PM 2 points [-]

In my interpretation, if they had found a significant effect, they would have been able to correctly conclude that there was an effect; and finding no significant effect, they could have correctly concluded the negation of that.

I am confused. In your article you said that researchers on food colouring and hyperactivity found no significant effect and concluded there was none, and criticised them for doing that since, according to later work, there is a significant effect among a small subpopulation. Now you are saying that they correctly concluded that there was no significant effect ("no significant effect" being the negation of "significant effect").

Comment author: PhilGoetz 09 April 2013 02:30:11PM 0 points [-]

What I said in my comment above is misleading. If they had found an effect, it would have meant something, although they would have again stated it as stronger than it really was: "For all children, food dye affects behavior." There could in fact have been one food dye monster child whose behavior was radically altered by food dye. Having failed to find an effect, they can conclude that they failed to find an effect on all children, which is still useful information but in practice would be very difficult to use correctly.