You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

AspiringRationalist comments on A toy model of the control problem - Less Wrong Discussion

19 Post author: Stuart_Armstrong 16 September 2015 02:59PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (24)

You are viewing a single comment's thread.

Comment author: AspiringRationalist 17 September 2015 01:15:46AM 0 points [-]

A's utility function also needs to be specified. How many utils is the first box worth? What's the penalty for additional boxes?

Comment author: Gurkenglas 04 December 2015 10:31:17AM 1 point [-]

Why is that needed? A's algorithm is fully known. Perhaps its behavior is identical to that induced by some utility function, but that needn't be how all agents are implemented.