Unnamed comments on Open Thread: January 2010 - Less Wrong

5 Post author: Kaj_Sotala 01 January 2010 05:02PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (725)

You are viewing a single comment's thread. Show more comments above.

Comment author: AllanCrossman 02 January 2010 01:14:03PM *  4 points [-]

Well, I was only going to post all the minutiae if there was any interest...

http://jama.ama-assn.org/cgi/reprint/295/3/285.pdf

The two groups are as follows:

Assigned to "Watchful Waiting":

  • 336 patients
  • 17 had problems after 2 years

Assigned to surgery:

  • 317 patients
  • 7 had problems after 2 years

Some patients crossed between the two groups, but this does not matter, as they were testing the effects of the initial assignment.

They report p = 0.52, but they also give a 95% confidence interval for the difference in risk, which just barely contains zero; which is a dead giveaway that p should be around 0.05, right? Anyway, doing a chi-squared test on the above numbers, I got p = 0.053.

The relevant bit is at the top of page 289 (page 6 of the PDF). Also relevant are the Results section of the abstract, and Figures 1 and 2. Essentially the entire problem is this statement:

At 2 years, intention-to-treat analyses showed that pain interfering with activities developed in similar proportions in both groups (5.1% for watchful waiting vs 2.2% for surgical repair; difference 2.86%; 95% confidence interval, -0.04% to 5.77%; P=.52)

Comment author: Unnamed 03 January 2010 02:40:35AM *  1 point [-]

You are correct, and the pdf that you linked contains a correction on its last page:

On page 285, in the “Results” section of the Abstract, the value reported as P=.52 for pain limiting activities should instead have been reported as P=.06; the corresponding value should also have been reported as P=.06 in the first paragraph on page 289.

It does not say anything about whether this affects their conclusions.

Comment author: AllanCrossman 03 January 2010 11:50:32AM *  0 points [-]

contains a correction on its last page

Argh how silly of me not to see that. I stop reading at the references! Honestly though, it's annoying that the abstract remains wrong.