Alicorn comments on Singularity the hard way - Less Wrong

-11 Post author: CCC 12 December 2012 07:07PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (30)

You are viewing a single comment's thread. Show more comments above.

Comment author: Alicorn 12 December 2012 08:13:40PM 7 points [-]

We are Friendlier than a paperclip maximizer, but we're not just-plain-Friendly. We can be led to do nasty things for all kinds of reasons in all kinds of ways, we are subject to goal distortion and various interfering biases even insofar as our goals are correct, and our goals aren't fully transparent to us to allow explicit unambiguous pursuit anyway.