AspiringRationalist comments on A toy model of the control problem - Less Wrong

19 Post author: Stuart_Armstrong 16 September 2015 02:59PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (24)

You are viewing a single comment's thread.

Comment author: AspiringRationalist 17 September 2015 01:15:46AM 0 points [-]

A's utility function also needs to be specified. How many utils is the first box worth? What's the penalty for additional boxes?

Comment author: Gurkenglas 04 December 2015 10:31:17AM 1 point [-]

Why is that needed? A's algorithm is fully known. Perhaps its behavior is identical to that induced by some utility function, but that needn't be how all agents are implemented.