MugaSofer comments on Siren worlds and the perils of over-optimised search - Less Wrong

27 Post author: Stuart_Armstrong 07 April 2014 11:00AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (411)

You are viewing a single comment's thread. Show more comments above.

Comment author: MugaSofer 20 May 2014 11:24:16AM 1 point [-]

we haven't discovered anything dangerously unfriendly... Or anything that can't be boxed.

Since many humans are difficult to box, I would have to disagree with you there.

And, obviously, not all humans are Friendly.

An intelligent, charismatic psychopath seems like they would fit both your criteria. And, of course, there is no shortage of them. We can only be thankful they are too rare relative to equivalent semi-Friendly intelligences, and too incompetent, to have done more damage than all the deaths and so on.

Comment author: TheAncientGeek 20 May 2014 01:08:18PM *  0 points [-]

Most humans are easy to box, since they can be contained jn prisons.

How likly is an .AI to be psychopathic that is not designed to be psychopathic?