Less Wrong is a community blog devoted to refining the art of human rationality. Please visit our About page for more information.

orthonormal comments on Robust Cooperation in the Prisoner's Dilemma - Less Wrong

69 Post author: orthonormal 07 June 2013 08:30AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (145)

You are viewing a single comment's thread. Show more comments above.

Comment author: orthonormal 06 June 2013 11:07:30PM *  4 points [-]

Yes! We checked that both formally and using the fixed-point evaluator. I should add that to the draft.

EDIT: Whoops, it's a little more complicated than I remember. They find mutual cooperation iff the system PrudentBot1 uses to prove (its opponent defects against DefectBot) is strong enough to prove the consistency of the system PrudentBot2 uses to prove (its opponent cooperates with it), and vice versa.

Comment author: cousin_it 07 June 2013 07:02:44AM *  4 points [-]

OK, I see. So, unlike FairBots, a PrudentBot using PA and PA+1 won't cooperate with a PrudentBot using PA+1 and PA+2. I wonder if that can be fixed?

Comment author: orthonormal 07 June 2013 12:40:49PM 3 points [-]

If I were submitting a modal agent, I'd probably use a PrudentBot that uses PA to look for mutual cooperation but PA+N (for some large N) to look for defection against DefectBot. There's not a simple downside to that variant.

In particular, Prudent(0,100)Bot finds mutual cooperation with Prudent(0,1)Bot, Prudent(99,1000)Bot, etc.

Comment author: Eugine_Nier 09 June 2013 06:30:26AM 0 points [-]

If I were submitting a modal agent, I'd probably use a PrudentBot that uses PA to look for mutual cooperation but PA+N (for some large N) to look for defection against DefectBot.

Or breakout the stronger systems, e.g., ZFC possibly with some inaccessible cardinals thrown in for good measure.

Comment author: orthonormal 09 June 2013 01:51:30PM 1 point [-]

That would be even better in practice, but it wouldn't be expressible in the modal formalism.