Vladimir_Nesov comments on AI cooperation in practice - Less Wrong

26 Post author: cousin_it 30 July 2010 04:21PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Article Navigation

Comments (157)

Comments (157)

You are viewing a single comment's thread. Show more comments above.

Comment author: AlephNeil 01 August 2010 09:56:11AM *  3 points [-] 
function main3() {
if (proves("A()=="Defect" && B()=="Cooperate""))
return "Defect";
if (proves("A()=="Cooperate" && B()=="Cooperate""))
return "Cooperate";
return "Defect";
}

Sorry if I'm being naive, but if we amend the program that way then doesn't it lose the ability to prove the Löb statement implies(proves(P), P) where P = "A()=='Cooperate' && B()=='Cooperate'"? (Due to the unprovability of unprovability.)

Comment author: Vladimir_Nesov 01 August 2010 10:20:07AM *  0 points [-]

This is true, and it's a bit disturbing that it took so long for someone to point that out. I feel that there should be a way out, but don't see what it is (and finding it might suggest interesting limitations).

Powered by Reddit Powered by Reddit