You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

Mark_Friedenbach comments on The paperclip maximiser's perspective - Less Wrong Discussion

28 Post author: Angela 01 May 2015 12:24AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (24)

You are viewing a single comment's thread. Show more comments above.

Comment author: [deleted] 02 May 2015 03:56:52PM 0 points [-]

They're often called explicit goals not utility functions. Utility function is a terminology from a very specific moral philosophy.

Also note that the orthogonality thesis depends on an explicit goal structure. Without such an architecture it should be called the orthogonality hypothesis.