agree with the point of em-hell. But I don't think it's very likely because I think that you could screen against sociopaths being uploaded.
The full quote:
Who would want to be like that anyway, when the alternative is to live in a digitally created state of bliss? You could still be part of what you consider to be "reality", so that you wouldn't feel bad if you were in a "fake" virtual reality.
You could still have real friends. What zero-sum games do you have in mind? Surely anything you find enjoyable now pales in comparison to what's possible and likely with WBE?
So, our monster-em would be an existential risk IF all these conditions are met:
Doesn't that seem unlikely?
First, I value friendships with real people. If I were an em, I would probably value friendships with real ems and not unconscious simulations.
If I valued torturing real people, em-version of me would probably value torturing real ems and not unconscious simulations.
Not all humans have pleasure as their summum bonum. Not all humans would want em-bliss.
Second, you do not know what this screening process would entail and whether it would be possible to fool it. You also do not know how unfriendly neurotypical ems could become.
Third, yes. Em-hell is unlikely....
If you were a utilitarian, then why would you want to risk creating an AGI that had the potential to be an existential risk, when you could eliminate all suffering with the advent of WBE (whole brain emulation) and hence virtual reality (or digital alteration of your source code) and hence utopia? Wouldn't you want to try to prevent AI research and just promote WBE research? Or is it that AGI is more likely to come before WBE and so we should focus our efforts on making sure that the AGI is friendly? Or maybe uploading isn't possible for technological or philosophical reasons (substrate dependence)?
Is there a link to a discussion on this that I'm missing out on?