Locaha comments on Robust Cooperation in the Prisoner's Dilemma - Less Wrong

69 Post author: orthonormal 07 June 2013 08:30AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (145)

You are viewing a single comment's thread.

Comment author: Locaha 16 June 2013 01:42:52PM 0 points [-]

Hmm... isn't FairBot theoretically imposible because of Halting problem?

Comment author: orthonormal 16 June 2013 03:16:52PM 4 points [-]

The halting problem implies that it's impossible to write a program that correctly deduces whether every other program halts or not. But you can write a program that correctly deduces whether many programs halt, and labels the rest "unknown".

Likewise, the finite version of FairBot checks whether there's a proof of cooperation of length less than N (for some large fixed N), cooperates if so, and defects otherwise. There are programs that cooperate with FairBot but have no short proof of that fact—and FairBot defects against those programs. (I.e. it defects against the "unknown" programs.)

Does that help clarify things?