Stuart_Armstrong comments on You're in Newcomb's Box - LessWrong

40 Post author: HonoreDB 05 February 2011 08:46PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (172)

You are viewing a single comment's thread.

Comment author: Stuart_Armstrong 01 February 2011 10:49:34AM 2 points [-]

By creating a simulation to interrogate, Omega/Prometheus/Azathoth have brought a being into existence, which means the being may have preferences to continue to exist (in some other form). So I'd tend to pick B for Prometheus, to continue existing. I wouldn't do so for Azathoth, because evolution doesn't have to create a living version of me to see what I would do; there is no "I" to regret dying or not existing there.

Comment author: datadataeverywhere 01 February 2011 04:04:05PM 0 points [-]

It was not my impression that Prometheus might strike me down for disappointing him. If so, this would definitely change my behavior!

Also, if that was the point, this post applies very badly Azathoth, so I heartily agree with you there.

Comment author: Stuart_Armstrong 02 February 2011 09:13:49AM 3 points [-]

Basically, it seems that Prometheus has to create some sort of conscious version of me to be able to answer the question (so there is an entity to "regret not continuing to exist") whereas Azathoth doesn't need to simulate me, just fiddle around with non-conscious genes.

Comment author: datadataeverywhere 02 February 2011 06:08:09PM 2 points [-]

Wow. This actually makes sense, but if this was the intention, nothing in the original post or any previous comment revealed this to me.

So, if the problem is rephrased as: "You might be in Prometheus' simulation, aiding him decide whether to create the real you..." (especially not telling me how many times Prometheus runs the simulation) then I can see the potential utility of doing as Prometheus wants.

I personally don't derive utility from the opportunity to be created in another world, or in the "real world", but I think many people might and do derive quite a lot of utility from it. For those people, in this specific phrasing of the test, I would suggest one-boxing. (I still wouldn't, but I don't mind having my simulation turned off)

I heartily agree with you that if this is the correct interpretation of the puzzle, it has no bearing on Azathoth and how to behave in the real world.