they got the answer, but didn't feel like "oh, I had a bias," they just felt like it was a trick question.
I haven't tried the triplet game on anyone yet, but this is the reaction I generally get in response to similar problems. In my (entirely anecdotal) experience, people are unable or unwilling to view rationality as a generally applicable principle. Instead, they treat it as a one-off tool that was designed to apply to a narrow set of specific problems.
"For example" -- people would say -- "you could use rationality to get a better price on your mortgage, or to demonstrate that Wiccans can't really affect reality through spells. But you couldn't use it to determine whether your homeopathic remedy really works, or whether your aunt Helga really does have prophetic dreams, or whether Christians can affect reality through prayer. These questions are altogether different from mortgage/Wicca/whatever questions, as everyone knows".
I don't think this kind of cognitive bias can be defeated by a 30-second pitch. In fact, I doubt it can be defeated at all.
You're talking with someone you like, and they ask you what you mean by rationality, or why you keep going to LessWrong meetups. Or you meet someone who might be interested in the site.
What do you say to them? If you had to explain to someone what LW-style rationality is in 30 seconds, how would you do it? What's your elevator pitch? Has anyone had any success with a particular pitch?
My Current Pitch:
My current best one, made up on the spot, lacking any foreplanning, basically consists of:
"Basically, our brains are pretty bad at forming accurate beliefs, and bad in fairly systematic ways. I could show you one, if you want."
Playing the triplet game with them, then revealing that the numbers just need to be ascending
Upon failure, "Basically, your brain just doesn't look for examples that disprove your hypothesis, so you didn't notice that it could have a been a more general rule. There are a bunch of others, and I'm interested in learning about them so that I can correct for them."
My Thoughts on That:
It's massively effective at convincing people that cognitive biases exist (when they're in the 80% that fails, which has always been the case for me so far), but pretty much entirely useless as a rationality pitch. It doesn't explain at all why people should care about having accurate beliefs, and takes it as a given that that would be important.
It's also far too dry and unfun (compared to say, Methods), and has the unfortunate side effect of making people feel like they've gotten tricked. It makes it look non-cultish though.
I suspect that other people can do better, and I'll comment later with one that I actually put thought into. There's a pretty good chance that I'll use a few of the more upvoted ones and see how they go over.