wedrifid comments on Link: "Health Care Myth Busters: Is There a High Degree of Scientific Certainty in Modern Medicine?" - Less Wrong

8 Post author: CronoDAS 01 April 2011 05:25AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (33)

You are viewing a single comment's thread.

Comment author: wedrifid 01 April 2011 08:04:50AM 7 points [-]

Here is what Eddy has found in his research. Give a group of cardiologists high-quality coronary angiograms (a type of radiograph or x-ray) of typical patients and they will disagree about the diagnosis for about half of the patients. They will disagree with themselves on two successive readings of the same angiograms up to one-third of the time. Ask a group of experts to estimate the effect of colon-cancer screening on colon-cancer mortality and answers will range from five percent to 95 percent.

An excerpt. Scary!

Comment author: Yvain 01 April 2011 09:17:00PM *  10 points [-]

Unfortunately, Scientific American doesn't give any clues as to what study this information comes from, and my attempts to find it have all come up blank (anyone else have more luck?)

Of the two studies I can find on inter-rater reliability of coronary angiography, one shows greater than 98%, and the other shows high 90s. No doubt these are completely different types of coronary scans with completely different criteria for success than whatever Eddy was doing, but given the lack of pointers to the original study it's impossible to say exactly what's going on.

Comment author: SilasBarta 01 April 2011 04:37:37PM 3 points [-]

Double-scary when you think about how much education one must (legally) get before becoming a cardiologist.

There's a huge amount of waste somewhere in all that.

Comment author: jimrandomh 01 April 2011 05:28:51PM 7 points [-]

As I understand it, medical school is very heavy on memorization - doctors are expected to absorb a huge quantity of data about procedures, medications, etc. So much memorization, in fact, that it's probably incompatible with a habit of model-checking everything. If that's true, then this would filter out the traits that medicine needs most to repair its practices.

Comment author: Raemon 01 April 2011 04:56:06PM 4 points [-]

Or the field really is that confusing, which wouldn't surprise me too much. You're dealing with variables that are constantly changing.

Comment author: SilasBarta 01 April 2011 08:06:22PM 2 points [-]

I'm pretty sure it doeesn't take 4 years of "whatever you feel like majoring in" in university before even starting med school, just to learn an angiogram classifier that a computer can probably outperform you on anyway.

At least, the English lit classes could probably be scrapped ...

Comment author: Raemon 01 April 2011 08:20:11PM 1 point [-]

When it comes to medicine, if computers CAN outperform the average person, we should probably be using computers anyway. (Yeah, that maxim applies to most professions, but most professions don't have lives on the line).

Comment author: SilasBarta 01 April 2011 08:22:54PM 3 points [-]

When it comes to medicine, if computers CAN outperform the average person, we should probably be using computers anyway.

Hey, if you want to get doctors to step out of the way on the grounds that a computer really can trounce their expert judgment, even in just a few domains ... well, you're going up against a lot of resistance.

Comment author: Raemon 01 April 2011 08:33:23PM *  4 points [-]

Well, yeah. That will definitely be an issue, if not now then in a few years. But I also wouldn't be surprised if this was a genuinely difficult task, and I don't know that statements like "a computer can probably outperform you" are justifiable to throw around, unless you actually know that computers DO have a better track record at the task in question.

Comment author: SilasBarta 01 April 2011 08:39:09PM *  2 points [-]

I hadn't read it myself, but I remember that there are a lot of stories like these in Ian Ayers's Supercrunchers and the success of simple algorithms over expert judgment and the resistance thereto. And Superfreakonomics mentioned the story of how hard it was to get doctors to wash their hands as often as necessary.