Less Wrong is a community blog devoted to refining the art of human rationality. Please visit our About page for more information.

nazgulnarsil3 comments on Can't Unbirth a Child - Less Wrong

24 Post author: Eliezer_Yudkowsky 28 December 2008 05:00PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (94)

Sort By: Old

You are viewing a single comment's thread.

Comment author: nazgulnarsil3 28 December 2008 06:33:45PM 1 point [-]

I think it's worth noting that truly unlimited power means being able to undo anything. But is it wrong to rewind when things go south? if you rewind far enough you'll be erasing lives and conjuring up new different ones. Is rewinding back to before an AI explodes into a zillion copies morally equivalent to destroying them in this direction of time? unlimited power is unlimited ability to direct the future. Are the lives on every path you don't choose "on your shoulders" so to speak?

Comment author: pnrjulius 20 April 2012 02:44:57PM 0 points [-]

It does seem intuitively right to say that killing something already existing is worse than not creating it in the first place.

(Though, formalizing this intuition is murder. Literally.)

Comment author: MugaSofer 15 January 2013 10:25:59AM 1 point [-]

formalizing this intuition is murder

... it is?

Comment author: wedrifid 15 January 2013 04:38:02PM 2 points [-]

Though, formalizing this intuition is murder. Literally.

No, murder requires that you kill someone (there are extra moral judgements necessary but the killing is rather unambiguous.)

Comment author: Brilliand 28 August 2015 05:26:02PM 0 points [-]

I read that quote as saying "if you formalize this intuition, you wind up with the definition of murder". While not entirely true, that statement does meet the "kill" requirement.

Comment author: DanielLC 15 January 2013 05:30:46AM 1 point [-]

A superintelligent AI doesn't have truly unlimited power. It can't even violate the laws of physics, let alone morality. If your moral system says that death is inherently bad, then undoing the creation of a child is bad.

Comment author: CAE_Jones 15 January 2013 06:27:13AM 2 points [-]

I often think about a rewound reality, where the only difference is the data in my brain... and the biggest problem I have with this is all the people that are born after the time I'd go back to that I don't want to unmake.

Of course, my attention span is terrible, so I never follow one of these long enough or thorough enough to simulate how I'd try to avert such issues... then chaos theory would screw it up in spite of all that. The point is that I concur.

Comment author: MugaSofer 15 January 2013 10:24:56AM 1 point [-]

I'm pretty sure that "rewinding" is different to choosing now not to create lives.