= 27d567bc2d48d9f40e9ccc20ea370b15)
wedrifid comments on Wanted: backup plans for "seed AI turns out to be easy" - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
= 783df68a0f980790206b9ea87794c5b6)
Loading…= b715d02e85f7b3b4ae65ca3d3e450868)
Subscribe to RSS Feed
Powered by Reddit
= f037147d6e6c911a85753b9abdedda8d)
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (62)
Agree up to 'let them FOOM'. FOOMing uploads seem potentially disastrous for all the usual reasons. Why not have the uploaded good humans research friendliness and CEV then plug it into the easy seed AI and let that FOOM?
Or is the above what you meant? It just seems so obviously superior that you could have been doing shorthand.
Could be either. I'd leave that choice up to the uploaded good humans.
Will the uploaded good humans still stay good once they are uploaded?
What is the test to make sure that a regular (though very smart) human will remain "good"?
Don't we have to select from a small pool of candidates who have not succumbed to temptation to abuse power?
I have to say that I can think of very few candidates who would pass muster in my mind and not abuse power.
Even here: Reading through many of the posts, we have widely conflicting "personal utility functions" most of whose owners would consider to be "good" utility functions and yet those who do not hold the same personal utility functions could consider the utility functions of others to be "bad".
To my way of thinking it's incredily risky to try to upload "good" humans.