You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

Viliam_Bur comments on Superintelligence 21: Value learning - Less Wrong Discussion

7 Post author: KatjaGrace 03 February 2015 02:01AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (33)

You are viewing a single comment's thread. Show more comments above.

Comment author: Viliam_Bur 03 February 2015 11:44:54AM *  3 points [-]

The obvious problem is lack of human intelligence. Whether a majority of people on Earth will agree with some question the AI will ask them using the cell phone... it will depend on how specifically the question was framed.

Does it invoke popular applause lights? The majority will say "yes".

Is it complicated? The majority will say: "I do not understand the question." Now what? Does the majority of those who answered otherwise decide? Then, for sufficiently complicated questions the answers will be decided by people who are unable to see their own lack of understanding.

Comment author: KatjaGrace 20 February 2015 07:31:42PM 0 points [-]

I agree these are problems with asking people questions, but they like much easier problems to solve than most involved with controlling AI.