You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

private_messaging comments on Stupid Questions Open Thread Round 3 - Less Wrong Discussion

8 Post author: OpenThreadGuy 07 July 2012 05:16PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (208)

You are viewing a single comment's thread. Show more comments above.

Comment author: private_messaging 08 July 2012 11:06:22AM *  2 points [-]

Yep. Even without the payoff - the blackmail immune agent is going to interact poorly with stupid blackmailer agent which simply doesn't understand that the blackmail immune agent won't pay. Or with evil blackmailer agent that just derives positive utility from your misfortune, which is the case with most blackmailers in practice.

The winning strategy depends to the ecosystem. The winning strategy among defect is defect, but among mixed tit-for-tat works great. The decision systems just tend to converge to a sort of self fulfilling prophecy solutions.

edit: i.e. there's a rock-paper-skissors situation between different agents, they are not well ordered in 'betterness'.