timtyler comments on Bayesians vs. Barbarians - Less Wrong

51 Post author: Eliezer_Yudkowsky 14 April 2009 11:45PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (270)

You are viewing a single comment's thread.

Comment author: timtyler 15 April 2009 01:18:21AM 4 points [-]

For seeing someone's source code to act as a commitment mechanism, you have to be reasonably sure that what they show you really is their source code - and also that their source code is not going to be modified by another agent between when they show it to you, and when they get a chance to defect.

While it's possible to imagine these conditions being met, it seems non-trivial to imagine a society where they are met very frequently.

If agents face one-shot prisoner's dilemmas with each other very often, there are other ways to get them to cooperate - assuming that they have a communications channel. They could use public-key crypto to signal to each other that they are brothers - in a way that only a real brother would know how to do.

Signalling brotherhood is how our cells cooperate with each other. Cells can't use cryptography - so their signals can more easily be faked - but future agents will be in a better position there.