You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

Stuart_Armstrong comments on Cooperating with agents with different ideas of fairness, while resisting exploitation - Less Wrong Discussion

38 Post author: Eliezer_Yudkowsky 16 September 2013 08:27AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Article Navigation

Comments (44)
Tags: bargaining negotiation exploitation logical_decision_theories tdt

Comments (44)

You are viewing a single comment's thread. Show more comments above.

Comment author: cousin_it 16 September 2013 12:46:31PM 2 points [-]

If I'm determining the outcome of the other player, doesn't that mean that I can change my "fair point" to threaten the other player with no downside for me? That might also lead to blackmail...

Comment author: Stuart_Armstrong 16 September 2013 02:01:24PM 2 points [-]

Indeed! And this is especially the case if any sort of negotiations are allowed.

But every system is vulnerable to that. Even the "random dictator", which is the ideal of unexploitability. You can always say "I promise to be a better (worse) dictator if you (unless you) also promise to be better".

Powered by Reddit Powered by Reddit