xxd comments on Wanted: backup plans for "seed AI turns out to be easy" - Less Wrong

18 Post author: Wei_Dai 28 September 2011 09:54PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (62)

You are viewing a single comment's thread. Show more comments above.

Comment author: xxd 20 December 2011 09:16:36PM *  0 points [-]

"But surely it's still much better than just getting wiped out"

I think that is the key here. If "just getting wiped out" is the definition of unfriendly then "not gettting wiped out" should be the MINIMUM goal for a putative "friendly" AI.

i.e. "kill no humans".

It starts to get complex after that. For example: Is it OK to kill all humans, but freeze their dead bodies at the point of death and then resurrect one or more of them later? Is it OK to kill all humans by destructively scanning them and then running them as software inside simulations? What about killing all humans but keeping a facility of frozen embryos to be born at a later date?