Manfred comments on Why isn't the following decision theory optimal? - Less Wrong

5 Post author: internety 16 April 2015 01:38AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (30)

You are viewing a single comment's thread. Show more comments above.

Comment author: Manfred 16 April 2015 10:16:24PM *  0 points [-]

I agree with you there - what I mean by selfish preferences is that after the copies are made, each copy will value a cookie for itself more than a cookie for the other copy - it's possible that they wouldn't buy their copy a cookie for $1, but would buy themselves a cookie for $1. This is the indexically-selfish case of the sort of preferences people have that cause them to buy themselves a $1 cookie rather than giving that $1 to GiveDirectly (which is what they'd do if they made their precommitments behind a Rawlsian veil of ignorance).

Comment author: Leonhart 20 April 2015 08:08:04PM 0 points [-]

Confused. What's incoherent about caring equally about copies of myself, and less about everyone else?

Comment author: Manfred 20 April 2015 09:48:39PM 0 points [-]

I don't think I said it was incoherent. Where are you getting that from?

To expand on a point that may be confusing: indexically-selfish preferences (valuing yourself over copies of you) will get precommitted away if you are given the chance to precommit before being copied. Ordinary selfish preferences would also get precommitted away, but only if you had the chance to precommit sometime like before you came into existence (this is where Rawls comes in).

So if you have a decision theory that says "do what you would have precommitted to do," well, you end up with different results depending on when people get to precommit. If we start from a completely ignorant agent and then add information, precommitting at each step, you end up with a Rawlsian altruist. If we just start form yesterday, then if you got copied two days ago you can be indexically selfish but if you got copied this morning you can't.

Comment author: VoiceOfRa 22 April 2015 04:02:41AM 2 points [-]

The problem is that Rawls gets the math wrong even in the case he analyzes.