eli_sennesh comments on Formalizing Two Problems of Realistic World Models - LessWrong

19 Post author: So8res 22 January 2015 11:12PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (5)

You are viewing a single comment's thread. Show more comments above.

Comment author: [deleted] 05 February 2015 09:43:48PM 0 points [-]

This absolutely makes it possible that under the vast majority of value systems the most “effective” agents would be ones that take over their inputs, but I think it makes sense in that case to say that those are the wrong value systems, rather than that the agent is ineffective.

Certainly the agent is ineffective. It destroyed information which could have reduced its value-uncertainty.