Can AI Agents with Divergent Interests Learn To Prevent Civilizational Failures?
Civilization failures occur when the system gets stuck in a state where obvious improvements exist but can't be implemented. This chapter from the book Inadequate Equilibria categorize the causes of civilization failures into three buckets: 1. Coordination failures. We can't magically coordinate everyone to be carbon-neutral for example. 2. Decision-makers...