MBlume comments on Counterfactual Mugging - Less Wrong

52 Post author: Vladimir_Nesov 19 March 2009 06:08AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (257)

Sort By: Leading

You are viewing a single comment's thread.

Comment author: MBlume 20 March 2009 12:58:30AM 10 points [-]

You know, if Omega is truly doing a full simulation of my cognitive algorithm, then it seems my interactions with him should be dominated by my desire for him to stop it, since he is effectively creating and murdering copies of me.

Comment author: Vladimir_Nesov 20 March 2009 01:20:13AM 13 points [-]

The decision doesn't need to be read off from a straightforward simulation, it can be an on-demand, so to say, reconstruction of the outcome from the counterfactual. I believe it should be possible to calculate just your decision, without constructing a morally significant computation. Knowing your decision may be as simple as checking whether you adhere a certain decision theory.

Comment deleted 20 March 2009 07:13:55AM [-]
Comment author: MBlume 20 March 2009 07:20:39AM 1 point [-]

but...if you're the emulated you...you're going to die after you give him/don't give him the money.

Comment deleted 20 March 2009 08:08:56AM *  [-]
Comment author: MBlume 21 March 2009 07:51:58AM 2 points [-]

It's not just about the USB sticks -- to me that seems inert. But if he's running you off those USB sticks for (let's say) a few hours every day, then you could (in fact there is a 1000/1001 chance that you will) wake up tomorrow morning and find yourself running from one of those drives, and know that there is a clear horizon of a few hours on the subjective experiences you can anticipate. This is a prospect which I, at least, would find terrifying.