khafra comments on The Urgent Meta-Ethics of Friendly Artificial Intelligence - Less Wrong

45 Post author: lukeprog 01 February 2011 02:15PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (249)

You are viewing a single comment's thread. Show more comments above.

Comment author: johnlawrenceaspden 30 October 2012 06:38:51PM 1 point [-]

What if they were created in a good environment, (20) stopped, and then restarted (goto 20) ?

Is that one happy immortal life or an infinite series of murders?

Comment author: DSimon 02 November 2012 05:53:37AM 0 points [-]

I think closer to the latter. Starting a simulated person, running them for a while, and then ending and discarding the resulting state effectively murders the person. If you then start another copy of that person, then depending on how you think about identity, that goes two ways:

Option A: The new person, being a separate running copy, is unrelated to the first person identity-wise, and therefore the act of starting the second person does not change the moral status of ending the first. Result: Infinite series of murders.

Option B: The new person, since they are running identically to the old person, is therefore actually the same person identity-wise. Thus, you could in a sense un-murder them by letting the simulation continue to run after the reset point. If you do the reset again, however, you're just recreating the original murder as it was. Result: Single murder.

Neither way is a desirable immortal life, which I think is a more useful way to look at it then "happy".