AspiringRationalist comments on Search Engines and Oracles - Less Wrong Discussion
You are viewing a comment permalink. View the original post to see all comments and the full post content.
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (7)
It's interesting to see not just that Wolfram Alpha gave an obviously wrong answer to "who was the first ruler of Russia", but why it gave that answer. It lists gives an "input interpretation" of: -Russia -Ruler -July 1, 2014
It's clear from that interpretation that Wolfram Alpha incorrectly interpreted the meaning of the word "first" in this context. The challenge at this stage is simply parsing the query, not the more nuanced task of what counts as "Russia" or who counts as a ruler that gallabytes mentioned. Because humans have very little difficulty with this task, we know that it can in principle be automated, but we may be a long way away from being able to do so.
A human (or more intelligent AI) trying to answer this question would also need to be able to deal with the sort of subtleties that gallabytes mentions, but I suspect the query simply doesn't contain enough context to interpret the semantics with high confidence, so it would probably be necessary to ask additional clarifying questions in order to provide the information the asker wants. An oracle AI could likely learn how to resolve some but not all of the ambiguities it faces (both syntactic and semantic) by predicting answers to the clarifying questions it asks and then updating based on the users' answers.