ketsuekigata comments on Experts vs. parents - Less Wrong

16 Post author: PhilGoetz 29 September 2010 04:48PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (23)

You are viewing a single comment's thread. Show more comments above.

Comment author: PhilGoetz 29 September 2010 05:50:32PM *  4 points [-]

You need to distinguish between absolute observations (child is hyperactive) and relative observations (child was more hyperactive today than yesterday). The meta-analysis cited above uses relative observations. That's why I wrote,

This isn't saying that parents reported more hyperactivity than professionals. It's saying that, across 15 double-blind placebo experiments, the behavior observed by parents had a strong correlation with whether the child received the test substance or the placebo, over four times as strong as that measured by professionals.

Also, this was across 15 studies, not one study.

Comment author: ketsuekigata 13 October 2010 12:07:45AM 0 points [-]

Also, this was across 15 studies, not one study.

The fact that it's 15 small studies rather than one large one actually works against it. Since the studies were conducted differently, the control is shaky.