You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

Dagon comments on Open thread, Sep. 28 - Oct. 4, 2015 - Less Wrong Discussion

3 Post author: MrMind 28 September 2015 07:13AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (198)

You are viewing a single comment's thread. Show more comments above.

Comment author: Dagon 28 September 2015 02:54:50PM 3 points [-]

Testing and credentialism is a mess. The basic problem is that it's unclear what the result should measure: how much the student knows, how much the student has learned, how intelligent the student is, how conscientious, or how well the student's capabilities line up with the topic. The secondary problem is that in most settings, the test should be both hard-to-game AND perfectly objective, such that there is no argument about correctness of answer (and such that grading can be done quickly).

I spend a lot of time interviewing and training interviewers for tech jobs. This doesn't have the first problem: we have a clear goal (determine whether the candidate is likely to perform well in the role, usually tested by solving similar problems as would be faced in the role). The second difficulty is similar - a good interview generates actual evidence of the candidate's likely success, not just domain knowledge. This takes a lot of interviewing skill to get the best from the candidate, and a lot of judgement in how to evaluate the approach and weigh the various aspects tested. We put a lot of time into this, and accept the judgement aspect rather than trying to reduce the time spent, automate the results, or be purely objective in assessment.