OrphanWilde comments on Debunking Fallacies in the Theory of AI Motivation - LessWrong

8 Post author: Richard_Loosemore 05 May 2015 02:46AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (343)

You are viewing a single comment's thread.

Comment author: OrphanWilde 12 May 2015 09:02:21PM 5 points [-]

There are seven billion SRIs out there, yes. And a nonzero number of them will kill you because you inconvenienced them, or interfered with their plans, or because it seemed "fun". They're "stable". And that's with many, many iterations of weeding out those which went too far awry, and with them still being extremely close to other human brains.

Bluntly: You have insufficient experience being a sociopath to create a sociopathic brain that will behave itself.