bryjnar comments on Delayed Gratification vs. a Time-Dependent Utility Function - Less Wrong

2 Post author: momothefiddler 06 May 2012 12:32AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (57)

You are viewing a single comment's thread. Show more comments above.

Comment author: momothefiddler 07 May 2012 11:31:42AM 0 points [-]

You're saying that present-me's utility function counts and no-one else's does (apart from their position in present-me's function) because present-me is the one making the decision? That my choices must necessarily depend on my present function and only depend on other/future functions in how much I care about their happiness? That seems reasonable. But my current utility function tells me that there is an N large enough that N utilon-seconds for other peoples' functions counts more in my function than any possible thing in the expected lifespan of present-me's utility function.

Comment author: bryjnar 07 May 2012 02:41:12PM 0 points [-]

Sure. That might well be so. I'm not saying you have to be selfish!

However, you're talking about utilons for other people - but I doubt that that's the only thing you care about. I would kind of like for Clippy to get his utilons, but in the process, the world will get turned into paperclips, and I care much more about that not happening! So if everyone were to be turned into paperclip maximizers, I wouldn't necessarily roll over and say, "Alright, turn the world into paperclips". Maybe if there were enough of them, I'd be OK with it, as there's only one world to lose, but it would have to be an awful lot!

Comment author: momothefiddler 07 May 2012 08:07:46PM 0 points [-]

So you, like I, might consider turning the universe into minds that most value a universe filled with themselves?

Comment author: bryjnar 07 May 2012 09:10:26PM 3 points [-]

I'd consider it. On reflection, I think that for me personally what I care about isn't just minds of any kind having their preferences satisfied, even if those are harmless ones. I think I probably would like them to have more adventurous preferences! The point is, what I'm looking at here are my preferences for how the world should be; whether I would prefer a world full of wire-headers or one full of people doing awesome actual stuff. I think I'd prefer the latter, even if overall the adventurous people didnt' get as many of their preferences satisfied. A typical wire-header would probably disagree, though!

Comment author: momothefiddler 08 May 2012 03:08:53AM 0 points [-]

Fair.