Risto_Saarelma comments on Work on Security Instead of Friendliness? - Less Wrong

29 Post author: Wei_Dai 21 July 2012 06:28PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (103)

You are viewing a single comment's thread. Show more comments above.

Comment author: Risto_Saarelma 02 September 2012 03:08:34PM 0 points [-]

Um. Shouldn't we be thinking "how will we get the FAI to conclude that replacing people with software is not harmless" not "If the FAI concludes that this is harmless..."

A lot of people here think that the quick assumption that unusual substrate changes necessarily imply death isn't well-founded. Arguing with the assumption that it is obviously true will not be helpful.

There should be a good single post or wiki page to like to about this debate (it also comes up constantly in cryonics discussions), but I don't think there is one.