Perplexed, have you come across the decision theory posts here yet? You'll find them pretty interesting, I think.
LW Wiki for the Prisoner's Dilemma
LW Wiki for timeless decision theory (start with the posts- Eliezer's PDF is very long and spends more time justifying than explaining).
Essentially, this may be beyond the level of humans to implement, but there are decision theories for an AI which do strictly better than the usual causal decision theory, without being exploitable. Two of these would cooperate with each other on the PD, given a chance to communicate beforehand.
Perplexed, have you come across the decision theory posts here yet? You'll find them pretty interesting, I think.
Yes, I have read them, and commented on them. Negatively, for the most part. If any of these ideas are ever published in the peer reviewed literature, I will be both surprised and eager to read more.
there are decision theories for an AI which do strictly better than the usual causal decision theory, without being exploitable. Two of these would cooperate with each other on the PD, given a chance to communicate beforehand.
I think that yo...
A monthly thread for posting rationality-related quotes you've seen recently (or had stored in your quotesfile for ages).