Strange7 comments on Mysterious Answers to Mysterious Questions - Less Wrong

71 Post author: Eliezer_Yudkowsky 25 August 2007 10:27PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (147)

Sort By: Old

You are viewing a single comment's thread. Show more comments above.

Comment author: wedrifid 18 October 2012 09:28:20AM 0 points [-]

So ... I should do things that result in less expected utility ... why?

I am happy to continue the conversation if you are interested. I am trying to unpack just where your intuitions diverge from mine. I'd like to know what your choice would be when faced with Newcomb's Problem with transparent boxes and an imperfect predictor when you notice that the large box is empty. I take the empty large box, which isn't a choice that maximises my expected utility and in fact gives me nothing, which is the worst possible outcome from that game. What do you do?

Comment author: Strange7 18 October 2012 01:51:24PM 0 points [-]

Two boxes, sitting there on the ground, unguarded, no traps, nobody else has a legal claim to the contents? Seriously? You can have the empty one if you'd like, I'll take the one with the money. If you ask nicely I might even give you half.

I don't understand what you're gaining from this "rationality" that won't let you accept a free lunch when an insane godlike being drops it in your lap.

Comment author: thomblake 18 October 2012 02:54:50PM 0 points [-]

I don't understand what you're gaining from this "rationality" that won't let you accept a free lunch when an insane godlike being drops it in your lap.

A million dollars.

Comment author: Strange7 18 October 2012 03:11:35PM 0 points [-]

No, you're not. You're getting an empty box, and hoping that by doing so you'll convince Omega to put a million dollars in the next box, or in a box presented to you in some alternate universe.

Comment author: DaFranker 18 October 2012 03:32:40PM *  0 points [-]

And by this exact reasoning, which Omega has successfully predicted, you will one-box, and thus Omega has successfully predicted that you will one-box and made the correct decision to leave the box empty.

Remember to trace your causal arrows both ways if you want a winning CDT.

Remember also Omega is a superintelligence. The recursive prediction is exactly why it's rational to "irrationally" one-box.

Comment author: Strange7 18 October 2012 04:05:44PM 0 points [-]

And by this exact reasoning, which Omega has successfully predicted, you will one-box, and thus Omega has successfully predicted that you will one-box and made the correct decision to leave the box empty.

Yes, that's why I took the one box with more money in it.

Strictly speaking the scenario being discussed is one in which Omega left a transparent box of money and another transparent box which was empty in front of Wedrifid, then I came by, confirmed Wedrifid's disinterest in the money, and left the scene marginally richer. I personally have never been offered money by Omega, don't expect to be any time soon, and am comfortable with the possibility of not being able to outwit something that's defined as being vastly smarter than me.

Remember also Omega is an insane superintelligence, with unlimited resources but no clear agenda beyond boredom. If appeasing such an entity was my best prospect for survival, I would develop whatever specialized cognitive structures were necessary; it's not, so I don't, and consider myself lucky.

Comment author: DaFranker 18 October 2012 04:13:49PM 1 point [-]

Ah, then in that case, you win. With that scenario there's really nothing you could do better than what you propose. I was under the impression you were discussing a standard transparent Newcomb.