Punoxysm comments on Open thread, Dec. 8 - Dec. 15, 2014 - Less Wrong Discussion
You are viewing a comment permalink. View the original post to see all comments and the full post content.
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (289)
Further thoughts on Imaginary Expertise...
I'm currently studying a final-year undergrad course in the mathematical underpinnings of statistics. This course has three prerequisite courses, all of which have the word "statistics" or "statistical" in the title. While the term has obviously come up beforehand, it was only a couple of chapters ago that we were given a formal definition for what a "statistic" is, (in the context of parameter sufficiency).
It occurred to me that if someone was ignorantly mouthing off about statistics, and you wanted to shut them up, you could do a lot worse than to ask "so, what exactly is a statistic?"
I've noticed beforehand that "so what exactly is money?" has a similar effect for economics pseudo-blowhards, and "so what exactly are numbers?" for maths. It's worth noting that these questions aren't even the central questions of those disciplines, (insofar as such broad categories have central questions), and they don't necessarily have canonical answers, but completely blanking on them seems indicative of immature understanding.
I've now taken to coming up with variants of these for different disciplines I think I know about.
This is somewhat unfair. If you already think someone's a blowhard, and you want to take the wind out of their sails, go for it, but a lot of people who have some legitimate expertise won't have a definition at their fingertips.
Or if they do know, you'll tip them off that you don't think much of them.
Or they might give a legitimate answer that differs from your own flawed understanding. In which case you're just a jerk to judge them by it.
Reiterating what I said to ChristianKI, it's not about seeing whether the person has a "correct answer", but whether they're already aware it's a non-trivial question.
I'd still say it's unfair. I was burned by a question like this in a job interview. Would you agree that that sort of high-pressure context is a poor place to ask questions like this?
I'm not sure how the conversation got here. Your question is reminiscent of a friend or partner talking about the perceived-wrongdoing they suffered at the hands of a mutual acquaintance, before asking "don't you agree it was wrong of them to do that?"
It's not obvious to me that interviews are a bad situation for questions like the ones I describe in the OP. I don't know the circumstances of the interview you experienced, though I can believe it was conducted poorly and you have my sympathies.
There are obviously social consequences to going round putting people on the spot with awkward questions all the time. If people can't exercise good judgement in this matter, I don't think anything I write will save them from themselves.
I'll clarify: I think the ability of people to respond adequately to these questions depends as much on their confidence as their knowledge, and that interpreting their answers is very subjective. In general, asking your suggested questions are a good way to make someone look dumb or fluster them, but not the best way to correctly identify their expertise. Only in limited contexts are questions like these asked in good faith.
They're still valuable to think about because if you're ever in a position to receive these sorts of questions, you should be prepared to give at least a couple types of concise and competent-sounding answers, whether the question is asked in good faith or not.