You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

Kaj_Sotala comments on 2012 Less Wrong Census Survey: Call For Critiques/Questions - Less Wrong Discussion

20 Post author: Yvain 19 October 2012 01:12AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (479)

You are viewing a single comment's thread. Show more comments above.

Comment author: Kaj_Sotala 19 October 2012 06:12:14AM 6 points [-]

True Prisoner's Dilemma: Cooperator or defect?

This is problematic, in that it depends a lot on what I know about the person I'm playing with. If it's a total stranger I'll probably defect, if it's a copy of me or someone that I think is committed to superrationality I'll probably cooperate.

Also, just "True Prisoner's Dilemma" is pretty vague - the actual rewards and penalties matter. I'm a lot more inclined to cooperate if the cost of my opponent defecting is "lose this game of Diplomacy" rather than "be tortured for 50 years".

Comment author: RobertLumley 19 October 2012 06:26:10AM 4 points [-]

I had these same objections, but I assumed he was referencing this particular formalization.

Comment author: Kaj_Sotala 19 October 2012 07:11:19AM 0 points [-]

Ah, I'd forgotten that one. That one's problematic as well, though, given that different people will value "2 billion lives saved" differently. Even ignoring issues of scope insensitivity when we're talking about numbers on this scale, for sufficiently selfish people the notion of saving lives would actually be less of a dilemma than if there was a personal cost to themselves. Or negative utilitarians might consider it a good thing if there were fewer humans on Earth, though you could possibly fix this by specifying that the disease kills slowly and painfully and causes more suffering than if the people lived normal lives, or something.

Comment author: Nominull 22 October 2012 01:26:01AM 1 point [-]

Yes, it depends entirely on who you're playing against. If it's a rock you obviously defect, if it's a copy of yourself you obviously cooperate, and then at some point between those two it switches from one to the other. True Prisoner's Dilemma is underspecified.