CCC comments on Rationality Quotes Thread February 2016 - Less Wrong

5 Post author: elharo 02 February 2016 06:17PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (92)

You are viewing a single comment's thread. Show more comments above.

Comment author: James_Miller 03 February 2016 04:59:44PM *  5 points [-]

In my experience on this planet, anything that is both important and corruptible (without detection) is already corrupted.

Scott Adams

Does this fit with your experience? As a cynical economist, I'm pleasantly surprised at how non-corrupt grading is at U.S. colleges.

Comment author: CCC 04 February 2016 08:00:29AM 0 points [-]

I feel I should point out that corrupt grading is easily detectable - one can often see it by looking at a corruptly graded paper, or by interviewing a candidate who got a high grade and finding that he does not know the subject. And thus, it is not covered by the Adams quote.

Moreover, universities have a strong incentive to not be corrupt in their grading - if they let people slip through without learning the work, employers will start to notice and discount qualifications from that institution, and then prospective students will hear of this and go to other institutions instead, and then the entire institution will collapse. (It's not immediate, or perfect, and quick action at the start of the process can save the institution, but it is a consideration).

Comment author: Zubon 05 February 2016 12:47:58PM 4 points [-]

Moreover, universities have a strong incentive to not be corrupt in their grading - if they let people slip through without learning the work, employers will start to notice and discount qualifications from that institution This assumes that employers are using a college degree primarily as a signal for education, outweighing conformity, conscientiousness, class, deference to authority, low time preferences, habitual credentialism, or anything else a degree might signal. We note that most employers want to know that you have a degree but not, say, "must have at least a B+ in Intermediate Microeconomics," so the entire degree might as well be pass/fail apart from the few hiring at the top of the graduating class. And no employer is going to detect or care whether you legitimately passed something not relevant to work. I had an undergraduate course in Magical and Occult Philosophy, and I have yet to be quizzed on Plotinus and Hermes Trismegistus during a job interview.

The fact that few employers request transcripts and fewer distinguish between "barely passing" and "summa cum laude" (maybe apart from recent graduates?) seems like pretty strong evidence about caring about grading corruption. You really need to corrupt your school's degree award process (like a diploma mill) before anyone will care about it.

Also, as Old_Gold suggests, if you count grade inflation as corruption of grading, empirically this incentive wasn't strong enough. We also note that across-the-board corruption of this type undermines incentives. If someone comes up with a better signal, the entire institution of universities would collapse, but most people have seemed to accept rampant grade inflation with a shrug rather than mostly ignoring degrees. It may eventually collapse, but on a time scale where it seems difficult to believe "this was due to grade inflation starting 50 years ago."

Comment author: CCC 06 February 2016 09:42:35PM 0 points [-]

You really need to corrupt your school's degree award process (like a diploma mill) before anyone will care about it.

Yes, that's true. The incentive works on grading corruption at the level of "this guy should have scored 10%, how did he pass?". It has no effect on grading corruption on the level of "this guy should have barely passed, how did he get a distinction?"

Comment author: Old_Gold 05 February 2016 02:52:12AM 7 points [-]

I feel I should point out that corrupt grading is easily detectable - one can often see it by looking at a corruptly graded paper,

Except who sees a paper except the grader and the student who wrote it?

Moreover, universities have a strong incentive to not be corrupt in their grading - if they let people slip through without learning the work, employers will start to notice and discount qualifications from that institution,

Empirically this incentive wasn't strong enough.

Comment author: Lumifer 06 February 2016 06:01:26PM 4 points [-]

You do have a recognizable style, y'know...

Comment author: CCC 06 February 2016 09:40:15PM 1 point [-]

Except who sees a paper except the grader and the student who wrote it?

External examiners?

Comment author: James_Miller 07 February 2016 08:36:09PM 0 points [-]

Very rare for undergrads.

Comment author: [deleted] 09 February 2016 11:12:12AM 2 points [-]

In the UK it is standard - my institution has blind marking, double marking and scrutiny by external examiners for all undergraduate exams. Blind marking: we only have a candidate number and not a student's name. Second marking: someone else evaluates the marks (grades) I give - in some cases independently; external examiner: someone from another institution checks that the marking criteria is being followed.

Blind marking could be circumvented in various ways, but doing so would be risky as the exams will be seen by others. Second marking and external examining are a huge time burden but achieve some degree of quality control, especially important as students don't get to see their exam papers again (perhaps the biggest surprise to staff and students who come here from the US and are used to post-exam argumentation as a form of "quality control").

Comment author: James_Miller 09 February 2016 02:27:09PM *  0 points [-]

students don't get to see their exam papers again

This screams "corruption". Knowing that students will be looking at how you grade their paper, and will be comparing how you grade them with how you grade others provides professors with some incentives to be honest and careful in grading.

Comment author: [deleted] 09 February 2016 05:40:51PM 1 point [-]

I'm surprised students put up with it, but they don't know anything different. They hear about US students who argue every single grade but I don't think they realise such students actually exist.

However I'm really happy to be away from my first (US) academic post where I constantly faced pressure from an athletic department to "relax" on grades or overlook "minor problems" from athlete-students. Post exam argumentation from individual students is easy enough to deal with reasonably and honestly, institutional forces are another beast entirely.

Comment author: James_Miller 05 February 2016 05:59:52PM 1 point [-]

Agreed.

Comment author: Good_Burning_Plastic 05 February 2016 01:05:31PM 1 point [-]

It's not immediate

That sounds like a hell of an understatement to me.

Comment author: CCC 06 February 2016 09:43:23PM 1 point [-]

It does somewhat understate the situation, yes.