Eliezer_Yudkowsky comments on Outlawing Anthropics: An Updateless Dilemma - Less Wrong

26 Post author: Eliezer_Yudkowsky 08 September 2009 06:31PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (194)

You are viewing a single comment's thread. Show more comments above.

Comment author: Eliezer_Yudkowsky 09 September 2009 06:18:33PM 1 point [-]

Again, if we randomly selected someone to ask, rather than having specified in advance that we're going to make the decision depend on the unanimous response of all people in green rooms, then there would be no paradox. What you're talking about here, pulling out a random marble, is the equivalent of asking a random single person from either green or red rooms. But this is not what we're doing!

Comment author: Psy-Kosh 09 September 2009 06:40:49PM 6 points [-]

Either I'm misunderstanding something, or I wasn't clear.

To make it explicit: EVERYONE who gets a green marble gets asked, and the outcome depends their consent being unanimous, just like everyone who wakes up in a green room gets asked. ie, all twenty rationalists draw a marble from the bucket, so that by the end, the bucket is empty.

Everyone who got a green marble gets asked for their decision, and the final outcome depends on all the answers. The bit about them drawing marbles individually is just to keep them from seeing what marbles the others got or being able to talk to each other once the marble drawing starts.

Unless I completely failed to comprehend some aspect of what's going on here, this is effectively equivalent to the problem you described.

Comment author: Eliezer_Yudkowsky 09 September 2009 07:29:17PM 8 points [-]

Oh, okay, that wasn't clear actually. (Because I'm used to "they" being a genderless singular pronoun.) In that case these problems do indeed look equivalent.

Hm. Hm hm hm. I shall have to think about this. It is a an extremely good point. The more so as anyone who draws a green marble should indeed be assigning a 90% probability to there being a mostly-green bucket.

Comment author: Psy-Kosh 09 September 2009 07:44:58PM *  1 point [-]

Sorry about the unclarity then. I probably should have explicitly stated a step by step "marble game procedure".

My personal suggestion if you want an "anthropic reasoning is confooozing" situation would be the whole anthropic updating vs aumann agreement thing, since the disagreement would seem to be predictable in advance, and everyone involved would appear to be able to be expected to agree that the disagreement is right and proper. (ie, mad scientist sets up a quantum suicide experiment. Test subject survives. Test subject seems to have Bayesian evidence in favor of MWI vs single world, external observer mad scientist who sees the test subject/victim survive would seem to not have any particular new evidence favoring MWI over single world)

(Yes, I know I've brought up that subject several times, but it does seem, to me, to be a rather more blatant "something funny is going on here")

(EDIT: okay, I guess this would count as quantum murder rather than quantum suicide, but you know what I mean.)

Comment author: byrnema 10 September 2009 02:48:03AM 0 points [-]

I don't see how being assigned a green or red room is "anthropic" while being assigned a green or red marble is not anthropic.

I thought the anthropic part came from updating on your own individual experience in the absence of observing what observations others are making.

Comment author: Psy-Kosh 10 September 2009 03:16:30AM 3 points [-]

The difference wasn't marble vs room but "copies of one being, so number of beings changed" vs "just gather 20 rationalists..."

But my whole point was "the original wasn't really an anthropic situation, let me construct this alternate yet equivalent version to make that clear"

Comment author: CarlShulman 10 September 2009 06:05:59AM 1 point [-]

Do you think that the Sleeping Beauty problem is an anthropic one?

Comment author: Psy-Kosh 11 September 2009 06:00:15AM 0 points [-]

It probably counts as an instance of the general class of problems one would think of as an "anthropic problem".

Comment author: byrnema 10 September 2009 04:03:25AM 0 points [-]

I see. I had always thought of the problem as involving 20 (or sometimes 40) different people. The reason for this is that I am an intuitive rather than literal reader, and when Eliezer mentioned stuff about copies of me, I just interpreted this as meaning to emphasize that each person has their own independent 'subjective reality'. Really only meaning that each person doesn't share observations with the others.

So all along, I thought this problem was about challenging the soundness of updating on a single independent observation involving yourself as though you are some kind of special reference frame.

... therefore, I don't think you took this element out, but I'm glad you are resolving the meaning of "anthropic" because there are probably quite a few different "subjective realities" circulating about what the essence of this problem is.

Comment author: Psy-Kosh 11 September 2009 06:05:01AM 0 points [-]

Sorry for delay.

Copies as in "upload your mind. then run 20 copies of the uploaded mind".

And yes, I know there's still tricky bits left in the problem, I merely established that those tricky bits didn't derive from effects like mind copying or quantum suicide or anything like that and could instead show up in ordinary simple stuff, with no need to appeal to anthropic principles to produce the confusion. (sorry if that came out babbly, am getting tired)

Comment author: brian_jaress 10 September 2009 06:58:40PM 0 points [-]

anyone who draws a green marble should indeed be assigning a 90% probability to there being a mostly-green bucket.

I don't think so. I think the answer to both these problems is that if you update correctly, you get 0.5.

Comment author: Psy-Kosh 11 September 2009 05:59:07AM *  2 points [-]

*blinks* mind expanding on that?

P(green|mostly green bucket) = 18/20

P(green|mostly red bucket) = 2/20

likelihood ratio = 9

if one started with no particular expectation of it being one bucket vs the other, ie, assigned 1:1 odds, then after updating upon seeing a green marble, one ought assign 9:1 odds, ie, probability 9/10, right?

Comment author: brian_jaress 11 September 2009 07:59:31AM 3 points [-]

I guess that does need a lot of explaining.

I would say:

P(green|mostly green bucket) = 1

P(green|mostly red bucket) = 1

P(green) = 1

because P(green) is not the probability that you will get a green marble, it's the probability that someone will get a green marble. From the perspective of the priors, all the marbles are drawn, and no one draw is different from any other. If you don't draw a green marble, you're discarded and the people who did get a green vote. For the purposes of figuring out the priors for a group strategy, your draw being green is not an event.

Of course, you know that you've drawn green. But the only thing you can translate it into that has a prior is "someone got green."

That probably sounds contrived. Maybe it is. But consider a slightly different example:

  • Two marbles and two people instead of twenty.
  • One marble is green, the other will be red or green based on a coin flip (green on heads, red on tails).

I like this example because it combines the two conflicting intuitions in the same problem. Only a fool would draw a red marble and remain uncertain about the coin flip. But someone who draws a green marble is in a situation similar to the twenty marble scenario.

If you were to plan ahead of time how the greens should vote, you would tell them to assume 50%. But a person holding a green marble might think it's 2/3 in favor of double green.

To avoid embarrassing paradoxes, you can base everything on the four events "heads," "tails," "someone gets green," and "someone gets red." Update as normal.

Comment author: Psy-Kosh 11 September 2009 08:10:31AM 1 point [-]

yes, the probability that someone will get a green marble is rather different than the probability that I, personally, will get a green marble. But if I do personally get a green marble, that's evidence in favor of green bucket.

The decision algorithm for how to respond to that though in this case is skewed due to the rules for the payout.

And in your example, if I drew green, I'd consider the 2/3 probability the correct one for whoever drew green.

Now, if there's a payout scheme involved with funny business, that may alter some decisions, but not magically change my epistemology.

Comment author: brian_jaress 11 September 2009 08:30:55AM 0 points [-]

What kind of funny business?

Comment author: wedrifid 11 September 2009 09:26:52AM 0 points [-]

Let's just say that you don't draw blue.

Comment author: brian_jaress 11 September 2009 04:05:09PM 1 point [-]

OK, but I think Psy-Kosh was talking about something to do with the payoffs. I'm just not sure if he means the voting or the dollar amounts or what.