This is a linkpost for https://transhumanaxiology.substack.com/p/the-elysium-proposal
Great stuff.
But I don't think anyone's extrapolated volition would be to build their utopias in the real world. Post-ASI, virtual is strictly better than real. Virtual utopias are less constrained by the laws of physics.
And it seems unlikely that anyone would choose to spend extended periods of time with pre-ASI humans rather than people made bespoke for them.
Also, it's not clear to me that we will get a bargaining scenario. Aligned ASI could just impose equal apportioning of compute budget. This depends on how AI progress plays out.
"We ideally want to move reality closer to the efficient frontier of personal utopia production."