You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

Aumann Agreement Game

9 Post author: abramdemski 09 October 2015 05:14PM

I've written up a rationality game which we played several times at our local LW chapter and had a lot of fun with. The idea is to put Aumann's agreement theorem into practice as a multi-player calibration game, in which players react to the probabilities which other players give (each holding some privileged evidence). If you get very involved, this implies reasoning not only about how well your friends are calibrated, but also how much your friends trust each other's calibration, and how much they trust each other's trust in each other.

You'll need a set of trivia questions to play. We used these

The write-up includes a helpful scoring table which we have not play-tested yet. We did a plain Bayes loss rather than an adjusted Bayes loss when we played, and calculated things on our phone calculators. This version should feel a lot better, because the numbers are easier to interpret and you get your score right away rather than calculating at the end.

Comments (9)

Comment author: gjm 09 October 2015 07:47:21PM *  3 points [-]

May I suggest that "Aumann Agreement Game" would be a better name than "Aumann's Agreement Game" because the latter suggests (falsely, I take it) that the game itself is Aumann's?

[EDITED to add:] In case it's not obvious, the title and content of this post used to say "Aumann's" rather than "Aumann".

Comment author: abramdemski 09 October 2015 09:28:46PM 1 point [-]

Yes, good point.

Comment author: shminux 09 October 2015 09:19:06PM *  5 points [-]

I wonder if the games you played had resembled the expected Aumann process, which is akin to random walk, or did they look more like slow convergence of opinions? If it's the latter, then the game has little to do with Aumann agreement.

Comment author: abramdemski 09 October 2015 09:34:24PM 0 points [-]

Regardless of how well it follows the random walk, it already violates the assumption of rational agents.

Comment author: shminux 09 October 2015 10:16:35PM *  2 points [-]

Then why take Aumann's name in vain?

Comment author: abramdemski 09 October 2015 11:44:33PM 0 points [-]

I think the relationship to Aumann's theorem is direct and strong. It's the same old question of how Aumann-like reasoning plays out in practice, for only partially rational agents, that was much discussed back in the Overcoming Bias days.

Comment author: abramdemski 10 October 2015 12:02:12AM 1 point [-]

Probably the most relevant post:

http://www.overcomingbias.com/2007/01/we_cant_foresee.html

Another game proposed to shed light on this:

http://www.overcomingbias.com/2007/01/the_coin_guessi.html

Comment author: Soothsilver 11 October 2015 12:10:56PM 2 points [-]

I like this very much. Did the game work in practice as you describe in the example?

Comment author: abramdemski 12 October 2015 08:20:03PM 0 points [-]

Essentially, yes! There were often a few more revisions than this, and the trolling was more subtle.