Vladimir_Nesov comments on UDT agents as deontologists - Less Wrong

8 Post author: Tyrrell_McAllister 10 June 2010 05:01AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (109)

You are viewing a single comment's thread. Show more comments above.

Comment author: Vladimir_Nesov 10 June 2010 12:47:23AM 0 points [-]

Saying that this decision is "right" has no explanatory power, gives no guidelines on the design of decision-making algorithms.

Comment author: Tyrrell_McAllister 10 June 2010 01:32:25AM *  0 points [-]

gives no guidelines on the design of decision-making algorithms.

I am nowhere purporting to be giving guidelines for the design of a decision-making algorithm. As I said, I am not suggesting any alteration of the UDT formalism. I was also explicit in the OP that there is no problem understanding at an intuitive level what the agent's builders were thinking when they decided to use UDT.

If all you care about is designing an agent that you can set loose to harvest utility for you, then my post is not meant to be interesting to you.

Comment author: Vladimir_Nesov 10 June 2010 01:40:23AM 2 points [-]

Beliefs should pay rent, not fly in the ether, unattached to what they are supposed to be about.

Comment author: Tyrrell_McAllister 10 June 2010 04:03:43AM *  0 points [-]

Beliefs should pay rent . . .

The whole Eliezer quote is that beliefs should "pay rent in future anticipations". Beliefs about which once-possible world is actual do this.

Comment author: Vladimir_Nesov 10 June 2010 10:33:42AM 0 points [-]

The beliefs in question are yours, and anticipation is about agent's design or behavior.