= 27d567bc2d48d9f40e9ccc20ea370b15)
DanielLC comments on Be Wary of Thinking Like a FAI - Less Wrong Discussion
You are viewing a comment permalink. View the original post to see all comments and the full post content.
= 783df68a0f980790206b9ea87794c5b6)
Loading…= b715d02e85f7b3b4ae65ca3d3e450868)
Subscribe to RSS Feed
Powered by Reddit
= f037147d6e6c911a85753b9abdedda8d)
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (25)
Why not? If it's trying to maximize human values, humans consider death to have negative value, and humans consider the FAI to be alive, then the FAI would try to die as little as possible, presumably by cloning itself less. It might clone itself a bunch early on so that it can prevent other people from dying and otherwise do enough good to make the sacrifice worth it, but it would still care about its personal identity over time.
You're equivocating. Humans consider death of humans to have negative value. If the humans that create the FAI don't assign negative value to AI death, then the FAI won't either.
It's not clear that humans wouldn't assign negative value to AI death. It's certainly intelligent. It's not entirely clear what other requirements there are, and it's not clear what requirements an AI would fulfill.