Dagon comments on The Truly Iterated Prisoner's Dilemma - Less Wrong

18 Post author: Eliezer_Yudkowsky 04 September 2008 06:00PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (85)

Sort By: Old

You are viewing a single comment's thread.

Comment author: Dagon 04 September 2008 07:59:55PM 0 points [-]

I THINK rational agents will defect 100 times in a row, or 100 million times in a row for this specified problem. But I think this problem is impossible. In all cases there will be uncertainty about your opponent/partner - you won't know its utility function perfectly, and you won't know how perfectly it's implemented. Heck, you don't know your OWN utility function perfectly, and you know darn well you're implemented somewhat accidentally. Also, there are few real cases where you know precisely when there will be no further games that can be affected by the current choice.

In cases of uncertainty on these topics, cooperation can be rational. Something on the order of tit-for-tat with an additional chance of defecting or forgiving that's based on expectation of game ending with this iteration might be right.