PhilGoetz comments on Experts vs. parents - Less Wrong

16 Post author: PhilGoetz 29 September 2010 04:48PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (23)

You are viewing a single comment's thread. Show more comments above.

Comment author: PhilGoetz 29 September 2010 05:50:32PM *  4 points [-]

You need to distinguish between absolute observations (child is hyperactive) and relative observations (child was more hyperactive today than yesterday). The meta-analysis cited above uses relative observations. That's why I wrote,

This isn't saying that parents reported more hyperactivity than professionals. It's saying that, across 15 double-blind placebo experiments, the behavior observed by parents had a strong correlation with whether the child received the test substance or the placebo, over four times as strong as that measured by professionals.

Also, this was across 15 studies, not one study.

Comment author: Sniffnoy 29 September 2010 09:04:05PM 6 points [-]

Also, blinding of the parents seems to be pretty key here.

Comment author: soreff 30 September 2010 09:23:59PM *  0 points [-]

Very much agreed. One particular worry is that the substances in question are dyes. If someone is observant enough to notice changes in visible color in excretions, or skin color, the blinding is gone.

One another note, the topic of study

the link between food dyes and hyperactivity

almost begs for a bad joke about low-lying excited states...

Comment author: PhilGoetz 01 October 2010 10:49:41PM 0 points [-]

No one has ever reported observing any such change from food dyes used in these dosages. These are comparable dosage levels to the amount of artificial coloring that most Americans eat every day.

Comment author: Sniffnoy 30 September 2010 11:28:44PM 0 points [-]

Huh, I had meant that as a point in favor of the studies! Which I suppose it still is, but it hadn't occurred to me that unblinding might occur in that way.

Comment author: ketsuekigata 13 October 2010 12:07:45AM 0 points [-]

Also, this was across 15 studies, not one study.

The fact that it's 15 small studies rather than one large one actually works against it. Since the studies were conducted differently, the control is shaky.