= 27d567bc2d48d9f40e9ccc20ea370b15)
OrphanWilde comments on Desires You're Not Thinking About at the Moment - Less Wrong Discussion
You are viewing a comment permalink. View the original post to see all comments and the full post content.
= 783df68a0f980790206b9ea87794c5b6)
Loading…= b715d02e85f7b3b4ae65ca3d3e450868)
Subscribe to RSS Feed
Powered by Reddit
= f037147d6e6c911a85753b9abdedda8d)
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (37)
That kind of attitude is an extremely effective way of -preventing- you from developing superhuman AI, or at least the kind you'd -want- to develop. Your superhuman AI needs to know the difference between plucked chickens and Greek philosophers.
I think I don't understand what you're saying.
If you try to formalize what "people" or "morally valuable agents" are - also known as tabooing the word "people" - then you run into problems with bad definitions that don't match your intuition and maybe think plucked chickens are people.
That's exactly why I'm arguing that you should not formalize or taboo "people", because it's not a natural category; it's something that is best defined by pointing to a human brain and saying "whatever the brain recognizes as people, that's people".
Are you going to put a human brain in your superhuman AI so it can use it for a reference?
I could if I had to. Or I could tell it to analyze some brains and remember the results.