Viliam_Bur comments on Superintelligence 21: Value learning - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (33)
The obvious problem is lack of human intelligence. Whether a majority of people on Earth will agree with some question the AI will ask them using the cell phone... it will depend on how specifically the question was framed.
Does it invoke popular applause lights? The majority will say "yes".
Is it complicated? The majority will say: "I do not understand the question." Now what? Does the majority of those who answered otherwise decide? Then, for sufficiently complicated questions the answers will be decided by people who are unable to see their own lack of understanding.
I agree these are problems with asking people questions, but they like much easier problems to solve than most involved with controlling AI.