You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

hyporational comments on The Danger of Invisible Problems - Less Wrong Discussion

14 Post author: Snorri 06 November 2014 10:28PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (55)

You are viewing a single comment's thread. Show more comments above.

Comment author: hyporational 07 November 2014 04:44:01PM *  1 point [-]

In general, statistical analysis of medical treatments runs into the issue that it's easy to ask the question "did everyone given treatment X get better?" and difficult to ask the question "how can we tell who will get better and who won't given treatment X?", and the latter question is the one that tends to be practically useful.

Anecdotes don't answer the latter question any better. Not even if you're given a statistically effective treatment and happen to improve. I suspect placebo is stronger the more dramatic the treatment.

Comment author: Vaniver 07 November 2014 06:32:12PM 2 points [-]

Anecdotes don't answer the latter question any better. Not even if you're given a statistically effective treatment and happen to improve.

Agreed that anecdotes are single points of data with potentially unknown selection effects. Not sure if I agree about the second part; it seems like treatment successes vary in their obviousness and I suspect some component of that measurement will always be anecdotal.

When you can do statistics, of course, you should; Gendlin's Focusing seems like a good example of the benefit of trying to figure out whether or not therapeutic success could be predicted (it could, and then they could target the success factor directly).

Comment author: hyporational 07 November 2014 07:09:15PM 0 points [-]

Interesting thing about anecdotal data is I tend to hugely overestimate my effect in making people better. To bring myself back to earth I look at the puny effects many treatments have been demonstrated to have and conclude many patients get better regardless of treatment. I certainly underestimate my faults too, but that's a tougher nut to crack. I've also seen doctors overestimate other doctor's faults; of course the failure to intervene with a treatment shown to avoid a bad outcome by a few percentage points killed the patient!