cousin_it comments on Prisoner's Dilemma (with visible source code) Tournament - Less Wrong

47 Post author: AlexMennen 07 June 2013 08:30AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (232)

You are viewing a single comment's thread. Show more comments above.

Comment author: Eliezer_Yudkowsky 10 June 2013 08:17:39AM 3 points [-]

But surely, good sir, common sense says that you should defect against CooperateBot in order to punish it for cooperating with DefectBot.

Also, in modal combat your bot is X=[]Y(CooperateBot) and is easily detected via the test [1](Y(X)<->[]X(CooperateBot)) where [1] denotes provability in T+Con(T), ie [1](Q) = []((~[]F)->Q).

Comment author: cousin_it 10 June 2013 10:01:07AM *  1 point [-]

Am I missing something, or does your detector use quantification, which is disallowed in Patrick's modal agents?

Comment author: Eliezer_Yudkowsky 10 June 2013 10:07:00AM 0 points [-]

Hm. I think X within the test could be introduced as a new constant and solved, but I'm not sure.

Comment author: Karl 10 June 2013 09:07:00PM 0 points [-]

The agent defined by wubbles is actually the agent called JustBot in the robust cooperation paper and which is proven to be non-exploitable by modal agents.

Comment author: Eliezer_Yudkowsky 10 June 2013 10:47:41PM 2 points [-]

JusticeBot cooperates with anyone who cooperates with FairBot, and is exploitable by any agent which comprehends source code well enough to cooperate with FairBot and defect against JusticeBot. Though I'm going here off the remembered workshop rather than rechecking the paper.

Comment author: Karl 11 June 2013 12:24:31AM *  0 points [-]

You're right, and wubbles's agent can easily be exploited by a modal agent A defined by A(X)=C <-> [] (X(PB)=C) (where PB is PrudentBot).