Vivid comments on Rationality Quotes September 2012 - Less Wrong

7 Post author: Jayson_Virissimo 03 September 2012 05:18AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (1088)

You are viewing a single comment's thread.

Comment deleted 01 September 2012 09:35:51AM *  [-]
Comment author: Ezekiel 02 September 2012 12:06:06PM 3 points [-]

Open question: Do you care about what (your current brain predicts) your transhuman self would want?

Comment author: Eliezer_Yudkowsky 03 September 2012 05:22:24AM 10 points [-]

If you don't, you're really going to regret it in a million years.

Comment author: wedrifid 03 September 2012 07:48:10AM 3 points [-]

If you don't, you're really going to regret it in a million years.

I'm rather skeptical about that, even conditioning on Ezekiel being around to care. I expect that the difference between him having his current preferences and his current preferences+more caring about future preferences will not result in a significant difference in the outcome the future Ezekiel will experience.

Comment author: Ezekiel 03 September 2012 05:50:51AM *  0 points [-]

The chance of human augmentation reaching that level within my lifespan (or even within my someone's-looking-after-my-frozen-brain-span) is, by my estimate, vanishingly low. But if you're so sure, could I borrow money from you and pay you back some ludicrously high amount in a million years' time?

More seriously: Seeing as my current brain finds regret unpleasant, that's something that reduces to my current terminal values anyway. I do consider transhuman-me close enough to current-me that I want it to be happy. But where their terminal values actually differ, I'm not so sure - even if I knew I were going to undergo augmentation.

Comment author: fiddlemath 02 September 2012 10:48:28PM 2 points [-]

Yes, I think so. It surely depends on exactly how I extrapolate to my "transhuman self," but I suspect that its goals will be like my own goals, writ larger