Psy-Kosh comments on True Ending: Sacrificial Fire (7/8) - Less Wrong

19 Post author: Eliezer_Yudkowsky 05 February 2009 10:57AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (90)

Sort By: Old

You are viewing a single comment's thread.

Comment author: Psy-Kosh 05 February 2009 03:34:22PM 4 points [-]

Something like this possibility occurred to me, but I don't think this actually is better.

At least, I think I'd have to be walked through the reasoning, since right now I _THINK_ I'd prefer Last Tears to Sacrificial Fire, conditioned on, well, the conditions I list in this comment holding.

ie, giving up pain/suffering in a _non_ wireheading way, and being altered to want to eat _non-and-never-have-been-conscious_ "pre humans" really doesn't seem all that bad to me, compared to the combined costs of defecting in single iteration PD (again, same ole metarationality arguments hold, especially when we imagine future different species we may encounter) + slaughter of everyone unable to escape from Huygens in time + (and I'm thinking this part is really important) missing out on all the wonderful complexities of interaction with the updated versions of the Babyeaters and the Superhappies.

Heck, the giving up pain/suffering thing in a non wireheading or otherwise-screw-us-up may actually be a right and proper thing. I'm not _entirely_ sure on this, though. As I've said elsewhere, main reason I'd want to keep it is simply a vague notion of not wanting to give up, well, any capability I have currently + want to be able to retain the ability to at least decode/comprehend my old memories.

I mean, I guess I get the idea of "our values are, well, our values, so according to them, maintaining those values is right", but... it sure seems to me that those very same values are telling me "Last Tears" has a higher preference ranking than this does.