You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

RobinZ comments on Come up with better Turing Tests - Less Wrong Discussion

13 Post author: Stuart_Armstrong 10 June 2014 10:47AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (44)

You are viewing a single comment's thread.

Comment author: RobinZ 10 June 2014 02:29:17PM 2 points [-]

Similar to your lazy suggestion, challenging the subject to a novel (probably abstract-strategy) game seems like a possibly-fruitful approach.

On a similar note: Zendo-variations. I played a bit on a webcomic forum using natural numbers as koans, for example; this would be easy to execute over a chat interface, and a good test of both recall and problem-solving.

Comment author: cousin_it 10 June 2014 05:18:41PM 3 points [-]

Maybe just do some roleplaying, with the judge as the DM.

Comment author: Punoxysm 13 June 2014 05:18:41PM *  0 points [-]

Nope; general game-playing is a well-studied area of AI; the AI's aren't great at it, but if you aren't playing them for a long time they can certainly pass as a bad human. Zendo-like "analogy-finding" has also been studied.

By only demanding very structured action types, instead of a more free-flowing, natural-language based interaction, you are handicapping yourself as a judge immensely.