komponisto comments on An Xtranormal Intelligence Explosion - Less Wrong

4 Post author: James_Miller 07 November 2010 11:42PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (80)

You are viewing a single comment's thread. Show more comments above.

Comment author: komponisto 08 November 2010 03:37:59AM 3 points [-]

If we want an AI to be friendly, the thing is to make sure that its utility function includes things that only humans can provide. That way, the AI will have to trade us what we want in order to get what it wants. The possibilities are endless. Give it a taste for... postmodern deconstructionism...

Won't work.

(Which suggests that this is probably not a good Friendliness strategy in general.)