= 27d567bc2d48d9f40e9ccc20ea370b15)
gwern comments on Hedging our Bets: The Case for Pursuing Whole Brain Emulation to Safeguard Humanity's Future - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
= 783df68a0f980790206b9ea87794c5b6)
Loading…= b715d02e85f7b3b4ae65ca3d3e450868)
Subscribe to RSS Feed
Powered by Reddit
= f037147d6e6c911a85753b9abdedda8d)
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (244)
I agree with a lot of your points about the advantages of WBE vs friendly AI. That said, look at the margins. Quite a few people are already working on WBE. Not very many people are working on friendly AI. Taking this into consideration, I think an extra dollar is better spent on FAI research than WBE research.
Also, a world of uploads without FAI would probably not preserve human values for long. The uploads that changed themselves in such a way to grow faster (convert the most resources or make the most copies of themselves) would replace uploads that preserved human values. For example, an upload could probably make more copies of itself it if deleted its capacities for humor and empathy.
I don't think any human being is stable or sane in the way FAI would be stable and sane.
If you were an upload, would you make copies of yourself? Where's the fun in that? The only reason I could see doing it is if I wanted to amass knowledge or do a lot of tasks... and if I did that, I'd want the copies to get merged back into a single "me" so I would have the knowledge and experiences. (Okay, and maybe some backups would be good to have around). But why worry about how many copies you could make? That sounds suspiciously Clippy-like to me.
In any case, I think we'd be more likely to be screwed over by uploads' human qualities and biases, than by a hypothetical desire to become less human.
This is, I think, an echo of Robin Hanson's 'crack of a future dawn', where hyper-Darwinian pressures to multiply cause the discarding of unuseful mental modules like humor or empathy which take up space.
Where do you get the idea that humor or empathy are not useful mental abiliites?!
From AngryParsley...