Vladimir_Nesov comments on UDT agents as deontologists - Less Wrong

8 Post author: Tyrrell_McAllister 10 June 2010 05:01AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (109)

You are viewing a single comment's thread. Show more comments above.

Comment author: Vladimir_Nesov 10 June 2010 12:35:04AM 0 points [-]

Okay, the characterization of P_Y seems right. For my reaction I blame the prior.

Returning to the original argument,

the agent always cares about all possible worlds according to how probable those worlds seemed to the agent's builders when they wrote the agent's source code.

P_Y is not a description of probabilities of possible worlds conceived by agent's builder, it's something produced by "mathematical intuition module" for a given output Y (or, strategy Y if you incorporate the later patch to UDT).

Comment author: Tyrrell_McAllister 10 June 2010 12:44:58AM 0 points [-]

P_Y is not a description of probabilities of possible worlds conceived by agent's builder, it's something produced by "mathematical intuition module" for a given output Y (or, strategy Y if you incorporate the later patch to UDT).

You are right here. Like you, I misremembered Wei Dai's notation. See my last (I hope) edit to that comment.

I would appreciate it if you edited your comment where you say that I was "very very wrong" to say that P isn't controlled by the agent's decisions.

Comment author: Vladimir_Nesov 10 June 2010 12:50:17AM *  3 points [-]

It's easier to have a linear discussion, rather than trying to patch everything by reediting it from the start (just saying, you are doing this for the third time to that poor top-level comment). You've got something wrong, then I've got something wrong, the errors were corrected as the discussion developed, moving on. The history doesn't need to be corrected. (I insert corrections to comments this way, without breaking the sequence.)

Comment author: Tyrrell_McAllister 10 June 2010 12:52:58AM 0 points [-]

Thank you for the edit.