This is a linkpost for https://foundational-research.org/s-risks-talk-eag-boston-2017/
So basically you are saying that the situation is asymmetric: the impact/magnitude of possible bad things is much much greater than the impact/magnitude of possible good things. Is this correct?
Yeah. One sign of asymmetry is that creating two universes, one filled with pleasure and the other filled with pain, feels strongly negative rather than symmetric to us. Another sign is that pain is an internal experience, while our values might refer to the external world (though it's very murky), so the former might be much easier to achieve. Another sign is that in our world it's much easier to create a life filled with pain than a life that fulfills human values.