Desrtopa comments on No Universally Compelling Arguments in Math or Science - Less Wrong

30 Post author: ChrisHallquist 05 November 2013 03:32AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (227)

You are viewing a single comment's thread. Show more comments above.

Comment author: Desrtopa 05 November 2013 10:44:03PM 0 points [-]

We will almost certainly avoid the literal clippy failure mode of an AI trying to maximize paperclips, but that doesn't mean that it's at all easy to avoid the more general failure mode of AI which try to optimize something other than what we would really, given full knowledge of the consequences, want them to optimize for.