You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

soren comments on Open thread, February 15-28, 2013 - Less Wrong Discussion

5 Post author: David_Gerard 15 February 2013 11:17PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (345)

You are viewing a single comment's thread. Show more comments above.

Comment author: moridinamael 16 February 2013 12:26:31AM *  11 points [-]

So, there are hundreds of diseases, genetic and otherwise, with an incidence of less than 1%. That means that the odds of you having any one of them are pretty low, but the odds of you having at least one of them are pretty good. The consequence of this is that you're less likely to be correctly diagnosed if you have one of these rare conditions, which again, you very well might. If you have a rare disorder whose symptoms include frequent headaches and eczema, doctors are likely to treat the headaches and the eczema separately, because, hey, it's pretty unlikely that you have that one really rare condition!

For example, I was diagnosed by several doctors with "allergies to everything" when I actually have a relatively rare condition, histamine intolerance; my brother was diagnosed by different doctors as having Celiac disease, severe anxiety, or ulcers, when he actually just had lactose intolerance, which is pretty common, and I still cannot understand how they systematically got that one wrong. In both cases, these repeated misdiagnoses led to years of unnecessary, significant suffering. In my brother's case, at one point they actually prescribed him drugs with significant negative side effects which did nothing to alter his lactose intolerance.

I don't intend to come off as bitter, although I suppose I am. My intent is rather to discuss strategies for avoiding this type of systematic misdiagnosis of rare conditions. This line of thought seems like a strong argument in favor of the eventual role of Watson-like AIs as medical diagnostic assistants. A quick Googling indicates that the medical establishment is at least aware of the need to confront the under-diagnosis of rare diseases, but I'm not seeing a lot of concrete policies. For the present time, I don't know what strategy a non-medically-trained individual should pursue, especially if the "experts" are all telling you that your watery eyes mean you have have hay fever when you really have some treatable congenital eye disease.

Comment author: [deleted] 16 February 2013 07:13:07AM 0 points [-]

As somebody who's had to deal with doctors because of a plethora of diseases, I must say you're absolutely right. (I also shadowed a few and am considering applying to med school.)

I don't remember what this concept is called, but basically it posits that "one should look for horses, not zebras" and is part of medical education. That is, a doctor should assume that the symptoms a patient has are caused by a common disease rather than by a rare one. So most doctors, thanks to their confirmation bias, dismiss any symptoms that don't fit the common disease diagnosis. (A girl from my town went to her physician because she complained of headaches. The good doctor said that she's got nothing to worry about and recommended more rest and relaxation. It turned out that the girl had a brain tumor which was discovered when she was autopsied. The good doctor is still practicing. Would this gross example of irrationality be tolerated in other professions? I think not.)

Most doctors are not so rational because of the way their education is structured: becoming a doctor isn't so much about reasoning but memorizing heaps of information ad verbatim. It appears that they are prone to spew curiosity-stoppers when confronted with diseases.

Comment author: Qiaochu_Yuan 16 February 2013 10:48:26PM *  9 points [-]

this gross example of irrationality

soren, please don't take this the wrong way, but based on what I've seen you post so far, you are not a strong enough rationalist to say things like this yet. You are using your existing knowledge of biases to justify your other biases, and this is dangerous.

Doctors have a limited amount of time and other resources. Any time and other resources they put into considering the possibility that a patient has a rare disease is time and other resources they can't put into treating their other patients with common diseases. In the absence of a certain threshold of evidence suggesting it's time to consider a rare disease (with a large space of possible rare diseases, most of the work you need to do goes into getting enough evidence to bring a given rare disease to your attention at all), it is absolutely completely rational to assume that patients have common diseases in general. .

Comment author: [deleted] 17 February 2013 07:09:26AM 2 points [-]

None taken, but how can you assess my level of rationality? When will I be enough rationalist to say things like that?

What bias did I use to justify another bias?

Again, testing a hypothesis when somebody's life is at stake is, I think, paramount to being a good doctor. What's the threshold of evidence a doctor should reckon?

Comment author: DanielLC 16 February 2013 08:05:50AM 7 points [-]

Would this gross example of irrationality be tolerated in other professions?

What gross example of irrationality? The vast majority of people with headaches don't have anything to worry about.

Comment author: NancyLebovitz 18 February 2013 03:35:01PM 3 points [-]

The question is whether "people with headaches" is the right reference class. If the headache is unusually severe or persistent, it makes sense to look deeper. Also, a doctor can ask for details about the headache before prescribing the expensive tests.

Comment author: DanielLC 20 February 2013 05:16:10AM 0 points [-]

More precisely, the question is whether or not the right reference class is one in which cancer tests are worth while. The headaches would have to be very unusually severe to get enough evidence.

Also, a doctor can ask for details about the headache before prescribing the expensive tests.

It was never mentioned whether or not the doctor asked for details. It's also possible that none of those reference classes are worth looking into, and she'd need headaches and something else.

Comment author: NancyLebovitz 20 February 2013 10:38:25PM 0 points [-]

Cancer isn't the only solvable problem which could get ignored if headaches are handled as a minor problem which will go away on their own.

Comment author: DanielLC 20 February 2013 11:50:08PM 0 points [-]

Yeah, but the other ones also get ignored if you assume it's cancer. To my knowledge, they have to be individually tested for. If none is worth testing for individually, it's best to ignore the headaches.

Comment author: [deleted] 16 February 2013 01:42:42PM *  0 points [-]

“The vast majority” != “All”. What's wrong with “you most likely have nothing to worry about, but I suggest doing this exam the off-chance that you do”? You've got to multiply the probability by the disutility, and the result can be large enough to worry about even if the probability is small. (Yes, down that way Pascal's mugging lies, but still.)

EDIT: Okay, given the replies to this comment I'm going to Aumann my estimate of the cost of tests for rare diseases upwards by a couple of orders of magnitude. Retracted.

Comment author: DanielLC 16 February 2013 08:13:14PM 6 points [-]

I'm pretty sure that, in this case, the probability is smaller than the disutility is large. Getting tested for cancer doesn't come cheap.

Comment author: ChristianKl 17 February 2013 06:13:19PM *  3 points [-]

Doctors get taught to practice evidence-based medicine. There's a lack of clinical trials that show that you can increase life span by routinically giving people who suffer from headaches brain scans.

If I understand the argument right, then doctors are basically irrational because the favor empirical results from trials over trying to think through the problem on a intellectual level?

Comment author: Kawoomba 17 February 2013 06:44:43PM 2 points [-]

What's wrong with “you most likely have nothing to worry about, but I suggest doing this exam the off-chance that you do”?

MONNAY.

You've got to multiply the probability by the disutility, and the result can be large enough to worry about even if the probability is small.

The question is, whose utility?

Comment author: beoShaffer 17 February 2013 01:03:34AM 2 points [-]

There's also the problem of false positives. Treatments for rare diseases are often expensive and/or carry serious side effects.

Comment author: [deleted] 17 February 2013 01:09:30AM 1 point [-]

I was thinking of diagnostics, not treatment, though from DanielLC's reply I guess I had underestimated the cost of that, too.

Comment author: ChristianKl 17 February 2013 06:13:46PM 2 points [-]

If you start diagnosing and find false positives than you are usually going to treat them.