= 27d567bc2d48d9f40e9ccc20ea370b15)
wedrifid comments on The Friendly AI Game - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
= 783df68a0f980790206b9ea87794c5b6)
Loading…= b715d02e85f7b3b4ae65ca3d3e450868)
Subscribe to RSS Feed
Powered by Reddit
= f037147d6e6c911a85753b9abdedda8d)
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (170)
Yes. The CEV<humankind> really could suck. There isn't a good reason to assume that particular preference system is a good one.
Good one according to which criteria? CEV<humankind> is perfect according to humankind's criteria if humankind were more intelligent and more sane than it currently is.
Mine. (This is tautological.) Anything else that is kind of similar to mine would be acceptable.
Which is fine if 'sane' is defined as 'more like what I would consider 'sane'. But that's because sane has all sorts of loaded connotations with respect to actual preferences - and "humanity's" may very well not qualify as not-insane.
How about CEV<the smart people>?
Yes, that would be preferable. But only because I assert a correlation between the attributes that produce what we measure as g and with personality traits and actual underlying preferences. A superintelligence extrapolating on <the smart people>'s preferences would, in fact, produce a different outcome than one extrapolating on <the rest>.
ArisKataris's accusation that you don't understand CEV means misses the mark. You can understand CEV and still not conclude that CEV<humanity> is necessarily a good thing.
And, uh, how do you define that?
Something like g, perhaps?
What would that accomplish? It's the intelligence of the AI that will be getting used, not the intelligence of the people in question.
I'm getting the impression that some people don't understand what CEV even means. It's not about the programmers predicting a course of action, it's not about the AI using people's current choice, it's about the AI using the extrapolated volition - what people would choose if they were as smart and knowledgeable as the AI.