You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

Squark comments on Identity and quining in UDT - Less Wrong Discussion

9 Post author: Squark 17 March 2015 08:01PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Article Navigation

Comments (26)
Tags: ai udt self-improvement decision-theory

Comments (26)

You are viewing a single comment's thread. Show more comments above.

Comment author: Squark 22 March 2015 07:47:48PM 0 points [-]

And because of XDT's decision controlling the contents of the box, when you say "the payoff is $1000 for two-boxing and $0 for one-boxing," you're begging the question about what you think the correct decision algorithm should do.

The problem is in the definition of "correct". From my point of view, "correct" decision algorithm means the algorithm that a rational precursor should build. That is, it is the algorithm instantiating which by the precursor will yield at least as much payoff as instantiating any other algorithm.

Comment author: Manfred 22 March 2015 11:04:59PM 0 points [-]

Well, I agree with you there :P But I think you're cashing this out as the fixed point of a process, rather than as the maximization I am cashing it out as.

Powered by Reddit Powered by Reddit