JGWeissman comments on Experts vs. parents - Less Wrong

16 Post author: PhilGoetz 29 September 2010 04:48PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (23)

You are viewing a single comment's thread.

Comment author: JGWeissman 29 September 2010 06:49:55PM *  1 point [-]

Did the experts just measure the absolute hyperactivity after treatment, or the difference in hyperactivity before and after treatment? I think measuring the difference would be the better choice to compare to parent's judgement. (And does it matter, in practice, whether it is the same expert who measures the child before treatment as after treatment?)

Comment author: PhilGoetz 29 September 2010 07:33:48PM 3 points [-]

They measured absolute hyperactivity over each time interval. When the study was finished, it was unblinded, so only then did they know which children were treated with the test substance during which intervals. They then subtracted the scores while on placebo from the scores while on substance. In short: They measured the difference.

It does matter who judges; standard practice is to find the correlation of all experts on a sample, and verify it's high, before the study begins.