Stuart_Armstrong comments on Will the ems save us from the robots? - Less Wrong

8 Post author: Stuart_Armstrong 24 November 2011 07:23PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (43)

You are viewing a single comment's thread. Show more comments above.

Comment author: Stuart_Armstrong 27 November 2011 05:20:58PM 5 points [-]

The case for WBE over AGI, simply put: the chances of getting a nice AI is vanishingly small. The chance of getting an evil AI is vanishingly small. The whole danger is in the huge "lethally indifferent" zone.

WBE are more likely to be nice, more likely to be evil, and less likely to be lethally indifferent. Since evil and lethally indifferent have similar consequences (and a lot of evil will be better than indifferent), this makes WBE better than AGI.