AspiringRationalist comments on A toy model of the control problem - Less Wrong Discussion
You are viewing a comment permalink. View the original post to see all comments and the full post content.
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (24)
A's utility function also needs to be specified. How many utils is the first box worth? What's the penalty for additional boxes?
Why is that needed? A's algorithm is fully known. Perhaps its behavior is identical to that induced by some utility function, but that needn't be how all agents are implemented.