Anatoly_Vorobey comments on Statistical Prediction Rules Out-Perform Expert Human Judgments - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (195)
That's what I thought too. The definitions I found searching all say that any interview where you decide what to ask and how to interpret the results is "unstructured". The only "structured" interviews seem to be tests with pre-determined sets of questions, and the candidate's answers judged by formal criteria.
I'm not sure this division of the "interview-space" is all that useful. I would distinguish three categories:
If I interpret the definitions I could find correctly, 3 is a "structured" interview, and both 1 and 2 are "unstructured". To my mind, there's a world of difference between 1 and 2, however. 1 is of very limited utility (I want to say "next to worthless", but that'd be too presumptuous), and, quite possibly, does no better than deciding on the basis of the resume alone, thought I'd still want to see the data to be convinced. 2, when performed by a trained and calibrated interviewer, is - again, in my own experience - obviously superior both to 1 and to deciding on the basis of the resume alone. Maybe this is somehow unique to the profession I interview for, but I doubt it.
Suppose there's research which demonstrates that in some setting type 1 interviews are worse than using the resume alone. I don't know whether this is the case in the papers cited in this post (I couldn't read them), but I find it plausible. Suppose then that the conclusions drawn are the universal statements "unstructured interviews reliably degrade the decisions of gatekeepers" and "if you're hiring, you're probably better off not doing interviews". I consider such conclusions then to be obviously unsubstantiated, incredibly overreached, and highly dangerous advice.