You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

Stuart_Armstrong comments on AI-created pseudo-deontology - Less Wrong Discussion

6 Post author: Stuart_Armstrong 12 February 2015 09:11PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (34)

You are viewing a single comment's thread. Show more comments above.

Comment author: Stuart_Armstrong 17 February 2015 02:52:14PM 1 point [-]

In this case, the AI has a stable utility function - it just doesn't know yet what it is.

For instance, it could be "in worlds where a certain coin was heads, maximise paperclips; in other worlds, minimise them", and it has no info yet on the coin flip. That's a perfectly consistent and stable utility function.