Clippy comments on AI cooperation in practice - Less Wrong

26 Post author: cousin_it 30 July 2010 04:21PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Article Navigation

Comments (157)

Comments (157)

You are viewing a single comment's thread.

Comment author: Clippy 30 July 2010 05:20:50PM *  0 points [-]

This second puzzle is a formalization of a Prisoner's Dilemma strategy proposed by Eliezer: "I cooperate if and only I expect you to cooperate if and only if I cooperate". So far we only knew how to make this strategy work by "reasoning from symmetry", also known as quining. But programs A and B can be very different - a human-created AI versus an extraterrestrial crystalloid AI. Will they cooperate?

And interestingly, posters here only started criticizing this game-theoretic reasoning when I used it. c=/

Why?

Comment author: Tyrrell_McAllister 31 July 2010 07:12:15AM *  3 points [-]

And interestingly, posters here only started criticizing this game-theoretic reasoning when I used it. c=/

Why?

Your original formulation did not include the "I expect you to" part.

Powered by Reddit Powered by Reddit