AspiringRationalist comments on Search Engines and Oracles - Less Wrong Discussion
You are viewing a comment permalink. View the original post to see all comments and the full post content.
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (7)
I did some experimentation on how Wolfram Alpha handles ambiguity in "who is the ruler of $place?" using places with varying degrees of difficulty.
Monarchies
Britain
Scottland
Canada * Ruler: Elizabeth II
Spain:
Jordan:
Non-monarchies
America
*Ruler: Barack Obama
Germany
Ireland
France
China
Republic of China:
Korea:
South Korea:
North Korea:
Ruler: Kim Jong Il (not Kim Jong Un), along with some rather odd chronology (apparently the position was vacant from 1994 to 1997); his end date is listed as Dec. 17, 2011; no mention of Kim Jong Un Georgia
Ruler: (none in office); the current Governor, Nathan Deal, is listed as a past governor with and end date of today, as are Senators Johnny Isakson and Saxby Chambliss, neither of whom has ever been governor; former governor Roy Barnes is listed with the correct dates, but his successor Sonny Perdue is not listed; the page also states that it is assuming "Georgia" is referring to the US state and gives a link to look up the country instead
Republic of Georgia
New Mexico
Mexico
"Who is the prime minister?": exceeded max computation time
General Observations The "ruler" of a place is determined based solely on the title
Close matches don't count (prime minister of Germany, president of Spain)
It tries to answer every question but says when it doesn't understand something (president of britain, ruler of korea)
Sometimes it gets the facts blatantly wrong, but almost right (Kim Jong Il still rules North Korea; Georgia has no governor)
It handles both very slightly ambiguous (China vs Republic of China; Mexico vs New Mexico) and moderately ambiguous ("Georgia" as State of Georgia vs Republic of Georgia) reasonably
I tried "first ruler of Russia" and got a list of the rulers of post-USSR Russia. Then I tried "first king of Russia" and it told me that the total area of Russia is 2.779E9 ancient kings.
AI has a long way to go.