Less Wrong is a community blog devoted to refining the art of human rationality. Please visit our About page for more information.

Will_Pearson comments on The Uses of Fun (Theory) - Less Wrong

15 Post author: Eliezer_Yudkowsky 02 January 2009 08:30PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (16)

Sort By: Old

You are viewing a single comment's thread.

Comment author: Will_Pearson 02 January 2009 11:26:22PM 0 points [-]

A random utility function will do fine, iff the agent has perfect knowledge.

Imagine, if you will a stabber, something that wants to turn the world into things that have been stabbed. If it knows that stabbing itself will kill itself, it will know to stab itself last. If it doesn't know know that stabbing itself will lead to it no longer being able to stab things, then it may not do well in actually achieving its stabbing goal by stabbing itself too early.