= 27d567bc2d48d9f40e9ccc20ea370b15)
Nisan comments on How not to be a Naïve Computationalist - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
= 783df68a0f980790206b9ea87794c5b6)
Loading…= b715d02e85f7b3b4ae65ca3d3e450868)
Subscribe to RSS Feed
Powered by Reddit
= f037147d6e6c911a85753b9abdedda8d)
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (34)
Does this mean you're thinking about uploaded people here? I think that is an important research question.
I was thinking about CEV, but yes, the same question applies to uploads (and is not the classic upload issue).
Good that you find it important. I'm going to dedicate some time to that research.
Does anyone have good reasons to say it is not a good research avenue?
What we value as good and fun may increase in volume, because we can discover new spaces with increasing intelligence. Will what we want to protect be preserved if we extrapolate human intelligence? Yes, if this new intelligence is not some kind of mind-blind autistic savant 2.0 who clearly can't preserve high levels of empathy and share the same "computational space". If we are going to live as separate individuals, then cooperation demands some fine tuned emphatic algorithms, so we can share our values with other and respect the qualitative space of others. For example, I may not enjoy dancing and having a homossexual relationship (I'm not a homophobe), but I'm able to extrapolate it from my own values and be motivated to respect its preservation as if it were mine (How? Simulating it. As a highly empathic person, I can say that it hurts to make others miserable. So it works as an intrinsic motivation and goal)