= 27d567bc2d48d9f40e9ccc20ea370b15)
Strilanc comments on Caelum est Conterrens: I frankly don't see how this is a horror story - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
= 783df68a0f980790206b9ea87794c5b6)
Loading…= b715d02e85f7b3b4ae65ca3d3e450868)
Subscribe to RSS Feed
Powered by Reddit
= f037147d6e6c911a85753b9abdedda8d)
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (47)
Well, I don't really remember the exact boundary between Friend is Optimal vs Caelum est Conterrens, but...
For me, it felt more realistic. I don't think anyone has actually thought of a non-destructive uploading process that is remotely plausible.
Attach lots of sensors to lots of axons, try to emulate the thing while it's running... for me, it's the on-line method that sounds more plausible compared to the "look at axons with microscopes and try to guess what they do" approach. Nevertheless, imagining a scenario with non-destructive uploads... how many times would you allow people to upload? Ending up with questions like that, I think it's the destructive one that would generate less horrifyingness...
The aliens with star communication weren't destroyed. They were close enough to "human" that they were uploaded or ignored. What's more, CelestAI would probably satisfy (most of) the values of these aliens, who probably find "friendship" just as approximately-neutral as they and we find "ponies".
Read it more carefully. One or several paragraphs before the designated-human aliens, it is mentioned that CelestAI found many sources of complex radio waves which weren't deemed "human".