Desrtopa comments on Thought experiment: The transhuman pedophile - Less Wrong

6 Post author: PhilGoetz 17 September 2013 10:38PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (74)

You are viewing a single comment's thread. Show more comments above.

Comment author: Desrtopa 29 September 2013 03:55:24PM 0 points [-]

That would imply that it was some sort of meta-negative utility, if I'm understanding you correctly. But if you're asking if I endorse self modifying to give up a value given near certainty of it being a lost cause, the answer is yes.

Comment author: MugaSofer 04 October 2013 09:42:49PM 0 points [-]

some sort of meta-negative utility

No, and that's why I suspect I'm misunderstanding. The same sort of negative utility - if you see something that gives you negative utility, you get negative utility and that - the fact that you got negative utility from something - gives you even more negative utility!

(Presumably, ever-smaller amounts, to prevent this running to infinity. Unless this value has an exception for it's own negative utility, I suppose?)

I mean, as a utility maximiser, that must be the reason you wanted to stop yourself from getting negative utility from things when those things would continue anyway; because you attach negative utility ... to attaching negative utility!

This is confusing me just writing it ... but I hope you see what I mean.

Comment author: Desrtopa 05 October 2013 03:34:51AM 2 points [-]

I mean, as a utility maximiser, that must be the reason you wanted to stop yourself from getting negative utility from things when those things would continue anyway; because you attach negative utility ... to attaching negative utility!

I think it might be useful here to draw on the distinction between trying to help and trying to obtain warm fuzzies. If something bad is happening and it's impossible for me to do anything about it, I'd rather not get anti-warm fuzzies on top of that.

Comment author: MugaSofer 07 October 2013 05:16:11PM 1 point [-]

Ah, that does make things much clearer. Thanks!

Yup, warm fuzzies were the thing missing from my model. Gotta take them into account.