Manfred comments on Preference For (Many) Future Worlds - Less Wrong

18 Post author: wedrifid 15 July 2011 11:31PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (37)

You are viewing a single comment's thread. Show more comments above.

Comment author: CarlShulman 16 July 2011 01:39:50AM *  20 points [-]

I think this sidesteps the underlying intuitions too quickly. We have cognitive mechanisms to predict "our next experience," memories of this algorithm working well, and preferences in terms of "our next experience." If we become convinced by the data that this model of a unique thread of experience is false, we then have problems in translating preferences defined in terms of that false model. We don't start with total utilitarian-like preferences over the fates of our future copies (i.e. most aren't eager to lower their standard of living by a lot so as to be copied many times (with the copies also having low standards of living)), and one needs to explain why to translate our naive intuitions into the additive framework (rather than something more like averaging).

Comment author: Manfred 16 July 2011 11:23:19PM -1 points [-]

Well, assuming that you generally don't want to die, quantum suicide is irrational (not independent of irrelevant alternatives). The extent to which we should do irrational things because we want to is definitely something to think about, but I think it's also alright to just say "it's irrational and that's bad."