I am a bit sceptical about whether or not it actually passed the Turing test. To me it looks more like a publicity stunts for the following reasons:
1) 5 minutes is a short period of time.
2) I don't believe Turing mentioned anything about 30% . I might be wrong on this one.
3) I don't know if the judges were properly trained. What questions did they ask? I feel like there must be plenty of questions related to IQ and creativity that a thirteen year old could answer with ease but that Eugene Goostman would struggle with. Examples: "Cow is to bull like, bitch is to ....?", or "Once upon a time there lived a pink unicorn in a big mushroom house with three invisible potatoes. Could you finish the story for me in a creative way and explain why the unicorn ended up painting the potatoes pink?" . The idea with the Turing test is that the computer should be indistinguishable from a human (in this case a 13 year old non native english speaker). I don't believe this criteria has been met until I see a chat transcript with reasonably hard questions.
4) Having the bot pose as a none native English speaking 13 year old might not be a violation of the rules, but I very much feel like it goes against the spirit of the Turing test. It reminds me a bit of this comic (http://existentialcomics.com/comic/15). But this is beside the point, I don't even think the bot would pass the Ukrainian-13-year-old-boy-turing-test if it was asked reasonably hard questions.
Until I learn more about the proceedings I remain utterly unconvinced that this is the milestone in AI media portrait it to be. It is nonetheless pretty cool!
Subscribe to RSS Feed
= f037147d6e6c911a85753b9abdedda8d)
Great post!