RobinZ comments on Come up with better Turing Tests - Less Wrong

13 Post author: Stuart_Armstrong 10 June 2014 10:47AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (44)

You are viewing a single comment's thread.

Comment author: RobinZ 10 June 2014 02:29:17PM 2 points [-]

Similar to your lazy suggestion, challenging the subject to a novel (probably abstract-strategy) game seems like a possibly-fruitful approach.

On a similar note: Zendo-variations. I played a bit on a webcomic forum using natural numbers as koans, for example; this would be easy to execute over a chat interface, and a good test of both recall and problem-solving.

Comment author: cousin_it 10 June 2014 05:18:41PM 3 points [-]

Maybe just do some roleplaying, with the judge as the DM.

Comment author: Punoxysm 13 June 2014 05:18:41PM *  0 points [-]

Nope; general game-playing is a well-studied area of AI; the AI's aren't great at it, but if you aren't playing them for a long time they can certainly pass as a bad human. Zendo-like "analogy-finding" has also been studied.

By only demanding very structured action types, instead of a more free-flowing, natural-language based interaction, you are handicapping yourself as a judge immensely.