Followup to: The Strangest Thing An AI Could Tell You
Brain damage patients with anosognosia are incapable of considering, noticing, admitting, or realizing even after being argued with, that their left arm, left leg, or left side of the body, is paralyzed. Again I'll quote Yvain's summary:
After a right-hemisphere stroke, she lost movement in her left arm but continuously denied it. When the doctor asked her to move her arm, and she observed it not moving, she claimed that it wasn't actually her arm, it was her daughter's. Why was her daughter's arm attached to her shoulder? The patient claimed her daughter had been there in the bed with her all week. Why was her wedding ring on her daughter's hand? The patient said her daughter had borrowed it. Where was the patient's arm? The patient "turned her head and searched in a bemused way over her left shoulder".
A brief search didn't turn up a base-rate frequency in the population for left-arm paralysis with anosognosia, but let's say the base rate is 1 in 10,000,000 individuals (so around 670 individuals worldwide).
Supposing this to be the prior, what is your estimated probability that your left arm is currently paralyzed?
Added: This interests me because it seems to be a special case of the same general issue discussed in The Modesty Argument and Robin's reply Sleepy Fools - when pathological minds roughly similar to yours update based on fabricated evidence to conclude they are not pathological, under what circumstances can you update on different-seeming evidence to conclude that you are not pathological?
An interesting thing happened to me yesterday, probably related to what happens with anosognosia. I was in my room at night, with computer turned on, in the opposite side of the room from the computer. Suddenly, the light went off. I looked around, and noticed that the light indicators around the computer were still on. "Circuit breaker must've overloaded on one of the lines, turning the light off, but not the computer", I thought. Then I heard a characteristic noise caused by the CRT monitor turning off. "Interesting coincidence", I thought, "exactly 15 minutes must've passed since I last touched the keyboard, just when the circuit breaker overloaded on another line". I went to a light switch and flipped it absent-mindedly. The lights went on. "Strange", I thought, "The switch must be to blame, it never happened before." This is all in the span of a few seconds.
Then it hit me: the lights were never on.
The room was illuminated only by the monitor, so when it switched off after 15 minutes of inactivity, it became dark. My mind confused this single thing for the light turning off, and then produced a whole sequence of complex thoughts around this single confusion, all the way relying on this fact being true. Inability to convince yourself that an equally simple fact is false must result in similarly complex justifications. There is nothing unnatural about justifications being long and detailed, the point of failure is where a fact can't be accepted, not where it just can't be noticed.
I do this all the time when I blink and wonder why the lights flickered. I used to verbalize my confusion and ask why the lights flickered. No one else saw it flicker and it took me awhile to realize that the flicker was me blinking. In addition, when the lights flicker, I usually blink. (To adjust for new light levels? You tell me...) Now, when the lights flicker or I blink I am stuck wondering which came first.