hylleddin comments on Near-Term Risk: Killer Robots a Threat to Freedom and Democracy - Less Wrong

10 Post author: Epiphany 14 June 2013 06:28AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (105)

You are viewing a single comment's thread.

Comment author: hylleddin 14 June 2013 07:08:26PM *  0 points [-]

It seems like a well publicized notarious event where a lethally autonomous robot killed a lot of innocent people would significantly broaden the appeal of friendliness research, and even could lead to disapproval of AI technology, similar to how Chernobyl had a significant impact on the current widespread disapproval of nuclear power.

For people primarily interested in existential UFAI risk, the likeliness of such an event may be a significant factor. Other significant factors are:

  • National instability leading to a difficult environment in which to do research

  • National instability leading to reckless AGI research by a group in attempt to gain an advantage over other groups.

Comment author: Pentashagon 14 June 2013 11:34:39PM 0 points [-]

Like this? Interestingly, it's alleged that the autonomous software may not have been the (direct) cause of the failure but that undetected mechanical failure led to the gun continuing to fire without active aiming.

Comment author: hylleddin 15 June 2013 12:00:26AM *  0 points [-]

Yes, but on a much larger scale.

Or possibly just a more dramatic scale. Three mile island had a significant effect on public opinion even without any obvious death toll.

Comment author: Epiphany 14 June 2013 07:39:53PM *  0 points [-]

I sincerely hope that the people have time to think this out before such an event occurs. Otherwise, their reaction may trigger the "cons" posted in the legislation suggestion.