= 27d567bc2d48d9f40e9ccc20ea370b15)
shminux comments on Living in the shadow of superintelligence - Less Wrong Discussion
You are viewing a comment permalink. View the original post to see all comments and the full post content.
= 783df68a0f980790206b9ea87794c5b6)
Loading…= b715d02e85f7b3b4ae65ca3d3e450868)
Subscribe to RSS Feed
Powered by Reddit
= f037147d6e6c911a85753b9abdedda8d)
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (17)
Matrixy scenarios have been discussed here and elsewhere (including xkcd and smbc) quite a bit, actually. Given that a superintelligence would be incomprehensible to mere mortals, it's kind of pointless to discuss this eventuality seriously. Plus you risk joining the dark world of anthropics. However, we can understand a similar situation from the other end: life of animals in the shadow of humans. Some of these humans are paperclip maximizers (displace animals to make room for crops), and others have an animal CEV value system (various animal rights groups). This has also been discussed a lot, of course. Unfortunately the only benefit of the latter discussion that I can see is that of a low inferential distance analogy in the fight to raise awareness of the potential dangers of "living in the shadow of superintelligence" to humans.
I observe that even animal rights groups are somewhat unlikely to assert the right of lions to eat humans, which an anthropomorphized lion would likely consider a fundamental value. So there's a limit to our Friendliness. :)
They're also somewhat unlikely to assert the right of the gazelles to not get eaten, which the gazelles would definitely consider a fundamental value. The occasional one does, but it's generally pretty far from their CEV.
I'm pretty sure that lions prefer gazelles to humans, and generally don't care too much as long as there is enough food. Maybe a decent zoo is what the lion CEV amounts to :)
Maybe a decent zoo is what the human CEV amounts to.
Yes, this has been suggested repeatedly, too, because the analogy is so obvious.