JGWeissman comments on Decision Theory Paradox: PD with Three Implies Chaos? - Less Wrong

19 Post author: orthonormal 27 August 2011 07:22PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (56)

You are viewing a single comment's thread.

Comment author: JGWeissman 27 August 2011 07:42:57PM 18 points [-]

If each TDT agent cares about its number of descendants, then they will instrumentally care about having a greater proportion of TDT agents to mutually cooperate with, and will therefore defect when one of the three players is a CDT agent, like the clique bot.

They only behave as you describe if they consider only the immediate, but not long term, consequences.

Comment author: Will_Sawin 27 August 2011 07:55:08PM 8 points [-]

Seems correct to me. Judging agents with a different utility function than they use to decide will lead to them looking stupid.

Comment author: orthonormal 31 August 2011 03:50:24AM 1 point [-]

I mentioned this to JGWeissman privately at the time, but I want to confirm now that this was exactly the solution I intended.