One person, one vote - a fundamental principle of our democratic government. But what happens in a world where one person can be copied, again and again?
That is the world described by Robin Hanson's "Em economics". Ems, or uploads, are human minds instantiated inside software, and hence can be copied as needed. But what is the fate of democratic government in such a world of copies? Can it be preserved? Should it be preserved? How much of it should be preserved? Those are the questions we'll be analysing at the FHI, but we first wanted to turn to Less Wrong to see the ideas and comments you might have on this. Original thoughts especially welcome!
To start the conversation, here are some of the features of idealised democracy (the list isn't meant to be exhaustive or restrictive, or necessarily true about real world democracies). Which of these could exist in an Em world, and which should?
- Democracy grants legitimacy to the government.
- Democracy is fair and egalitarian - each person has a single vote.
- Democracy aligns the interests of the rulers with that of the ruled.
- Democracy is stable - powerful groups can generally seize power within the structure, rather than overthrowing it.
- Democracy allows the competition of governing ideas.
- Democracy often leads to market economies, which generate large wealth.
- Democracy often lead to welfare states, which increase happiness.
- Democracy doesn't need to use certain coercive methods, such as restrictions on free speech, that other systems require to remain stable.
- Democracy stops a particular group from hanging on to power indefinitely, which can reduce corruption, inefficiency and excessive use of state power for private purposes.
EDIT: For clarification purposes, I am not claiming that democracies achieve these goals, or that these are all desirable. They are just ideas to start thinking about.
What's sane? That's socially constructed. What's good at reproducing, at getting more resources? That is not. Absent some mechanism to keep values from drifting ems will experience massive, swift value drift. This will be the case even if they stay within the space of current human neurological diversity, which they won't.
The only way the future isn't a hardscrabble hell is with a friendly Singleton.
I'd say absent some mechanism to keep them sane, an old enough EM couldn't even be considered intelligent, and would only be a danger to the rest of us in that it's a resource drain if we can't stomach euthanasia.
We may or may not naturally have such a mechanism.
By "current human neurological diversity" do you mean staying within what we now consider a sane human (in which case values drift will be limited to what a sane human would value), or do you mean that they're not modding their mind?
My opinion is the same for if you mean that EMs are modding themselves, except for the part about that there might be a built-in mechanism for keeping them sane.