I've been thinking about this some more, and I'd like to consult your intuitions on some related questions, if you don't mind.
Suppose I come along at T1 and noninvasively copy you into a form capable of effectively hosting everything important about you. (E.g., a software upload, or a clone body, or whatever it takes.) I don't tell either of you about the other's existence.
Let's label the resulting wedrifids W1 and W2 for convenience. (Labels randomly assigned to the post-copy yous.)
I then at T2 convert W2 into a chunk of pure orgasmium (O).
If I've understood your view, you would say that at T2, W1 undergoes a utility change (equal to [value(W2) - value(O)]), though of course W1 is unaware of the fact. Yes?
Whereas in an alternative scenario where at T2 I create a chunk of orgasmium (O2) out of interstellar hydrogen, without copying you first, W1 (which is uniquely you) doesn't experience any utility change at all at T2. Yes?
Feel free to replace the orgasmium with anything else... rocks, a different person altogether, a puppy, W2 experiencing a thousand years of torture, etc. .... if that changes your intuitions.
As situations become harder to imagine in an tangible sense it becomes harder extrapolate from intuitions meaningfully. But I can give some response in this case.
I then at T2 convert W2 into a chunk of pure orgasmium (O).
If I've understood your view, you would say that at T2, W1 undergoes a utility change (equal to [value(W2) - value(O)]), though of course W1 is unaware of the fact. Yes?
Utility functions operate over entire configuration states of the universe - values of objects or beings in the universe can not by default be added or subtracted. Crud...
I have been trying to absorb the Lesswrong near-consensus on cryonics/quantum mechanics/uploading, and I confess to being unpersuaded by it. I'm not hostile to cryonics; just indifferent, and having a bit of trouble articulating why the insights on identity that I have been picking up from the quantum mechanics sequence aren't compelling to me. I offer the following thought experiment in hopes that others may be able to present the argument more effectively if they understand the objection here.
Suppose that Omega appears before you and says, “All life on Earth is going to be destroyed tomorrow by [insert cataclysmic event of your choice here]. I offer you the chance to push this button, which will upload your consciousness to a safe place out of reach of the cataclysmic event, preserving all of your memories, etc. up to the moment you pushed the button and optimizing you such that you will be effectively immortal. However, the uploading process is painful, and because it interferes with your normal perception of time, your original mind/body will subjectively experience the time after you pushed the button but before the process is complete as a thousand years of the most intense agony. Additionally, I can tell you that a sufficient number of other people will choose to push the button that your uploaded existence will not be lonely.”
Do you push the button?
My understanding of the Lesswrong consensus on this issue is that my uploaded consciousness is me, not just a copy of me. I'm hoping the above hypothetical illustrates why I'm having trouble accepting that.