cupholder comments on Conditioning on Observers - Less Wrong

6 Post author: Jonathan_Lee 11 May 2010 05:15AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (118)

You are viewing a single comment's thread. Show more comments above.

Comment author: neq1 13 May 2010 10:59:15AM *  8 points [-]

Intuition Pump

Suppose 50% of people in a population have an asymptomatic form of cancer. None of them know if they have it. One of them is randomly selected and a diagnostic test is carried out (the result is not disclosed to them). If they don't have cancer, they are woken up once. If they do have it, they are woken up 9 times (with amnesia-inducing drug administered each time, blah blah blah). Each time they are woken up, they are asked their credence (subjective probability) for cancer.

Imagine we do this repeatedly, randomly selecting people from a population that has 50% cancer prevalence.

World A: Everyone uses thirder logic

Someone without cancer will say: "I'm 90% sure I have cancer"

Someone with cancer will say: "I'm 90% sure I have cancer." "I'm 90% sure I have cancer." "I'm 90% sure I have cancer." "I'm 90% sure I have cancer." "I'm 90% sure I have cancer." "I'm 90% sure I have cancer." "I'm 90% sure I have cancer." "I'm 90% sure I have cancer." "I'm 90% sure I have cancer."

Notice, everyone says they are 90% sure they have cancer, even though only 50% of them actually do.

Sure, the people who have cancer say it more often, but does that matter? At an awakening (you can pick one), people with cancer and people without are saying the same thing.

World B: Everyone uses halfer logic

Someone without cancer will say: "I'm 50% sure I have cancer"

Someone with cancer will say: "I'm 50% sure I have cancer." "I'm 50% sure I have cancer." "I'm 50% sure I have cancer." "I'm 50% sure I have cancer." "I'm 50% sure I have cancer." "I'm 50% sure I have cancer." "I'm 50% sure I have cancer." "I'm 50% sure I have cancer." "I'm 50% sure I have cancer."

Here, half of the people have cancer, and all of them say they are 50% sure they have cancer.

My question: which world contains the more rational people?

Comment author: cupholder 13 May 2010 09:25:03PM *  2 points [-]

I like your example because it mirrors my thinking about the Sleeping Beauty puzzle, and brings it out even more strongly: whether the 1/2 or 1/3 answer (or 50% or 90% answer) is appropriate depends on which probability one is interested in.

My question: which world contains the more rational people?

Depends on how you define someone being rational/well-calibrated.

In Halfer Country, when someone says they're 50% sure of having cancer, they do indeed have a 50% chance of having cancer.

In Thirder Land, any time someone makes the statement 'I'm 90% sure I have cancer', the statement has a 90% chance of coming from someone who has cancer.

Some of us were evidently born in Thirder Land, others in Halfer Country; my intuition works halferly, but the problem's a bit like a Necker cube for me now - if I think hard enough I can press myself into seeing the other view.

Comment author: cousin_it 14 May 2010 05:31:49AM *  4 points [-]

Your comment and neq1's intuition pump prompted me to create the following reformulation of the problem without amnesia:

I flip a coin hidden from you, then ask you to name a number. If the coin came up heads, I write your answer into my little notebook (which, incidentally, is all you care about). If it came up tails, I write it in the notebook twice.

When the problem is put this way, it's clear that the answer hinges on how exactly you care about my notebook. Should it matter to us how many times we express our credence in something?

Comment author: neq1 14 May 2010 11:27:45AM 1 point [-]

You make a good point. However, I'd argue that those in Thirder Land had nothing to update on. In fact, it's clear they didn't since they all give the same answer. If 50% of the population has cancer, but they all think they do with 0.9 probably, that's not necessarily less accurate than if everyone thinks they have cancer with 0.5 probability (depends on your loss function or whatever). But the question here is really about whether you had evidence to shift from .5 to .9.