Wei_Dai comments on An Alternative Approach to AI Cooperation - Less Wrong

6 Post author: Wei_Dai 31 July 2009 12:14PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (25)

You are viewing a single comment's thread. Show more comments above.

Comment author: Wei_Dai 31 July 2009 10:17:22PM *  0 points [-]

I don't just assign some agreement without considering a process of reaching it. I make that a separate problem to be solved, and just assume here that AIs do have some way to reach agreements by bargaining, in order to focus on the mechanism for enforcement of agreements.

ETA: Do you think common knowledge of source code can help with the bargaining problem in some way? Maybe that's the insight I'm missing?