wedrifid comments on The I-Less Eye - Less Wrong

30 Post author: rwallace 28 March 2010 06:13PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (83)

You are viewing a single comment's thread. Show more comments above.

Comment author: Wei_Dai 31 March 2010 02:06:27PM 2 points [-]

Thought experiments with mind-copying effectively involve dramatically changing the agent's values, but don't emphasize this point, as if it's a minor consideration.

Morendil's comment made me realize that my example is directly analogous to your Counterfactual Mugging: in that thought experiment, Omega's coin flip splits you into two copies (in two different possible worlds), and like in my example, the rational thing to do, in human terms, is to sacrifice your own interests to help your copy. To me, this analogy indicates that it's not mind-copying that's causing the apparent value changes, but rather Bayesian updating.

Getting around this particular implementation, directly to preference represented by it, and so being rational in situations of mind-copying, is not something humans are wired to be able to do.

I tend to agree with you, but I note that Eliezer disagrees.

Comment author: wedrifid 31 March 2010 02:36:18PM *  0 points [-]

to me, this analogy indicates that it's not mind-copying that's causing the apparent value changes, but rather Bayesian updating.

Is that an area in which a TDT would describe the appropriate response using different words to a UDT, even if they suggest the same action? I'm still trying to clarify the difference between UDT, TDT and my own understanding of DT. I would not describe the-updating-that-causes-the-value-changes as 'bayesian updating', rather 'naive updating'. (But this is a terminology preference.)

Comment author: Wei_Dai 02 April 2010 10:45:41AM 1 point [-]

My understanding is that TDT would not press the button, just like it wouldn't give $100 to the counterfactual mugger.

Comment author: wedrifid 05 April 2010 08:18:09AM 0 points [-]

Thanks. So they actually do lead to different decisions? That is good to know... but puts me one step further away from confidence!