You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

someonewrongonthenet comments on Exams and Overfitting - Less Wrong Discussion

12 Post author: robot-dreams 06 January 2015 07:35PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (47)

You are viewing a single comment's thread.

Comment author: someonewrongonthenet 06 January 2015 10:44:23PM *  8 points [-]

1) I get upset when professors construct their classes such that overfitters are rewarded to the extent that the opportunity cost associated with actually learning the material might cause one to fall behind. It happens in 70% of introductory courses and 35% of advanced courses. Also, 90% of multiple choice formats are guilty of this.

2) Random samples of the material inherently reward "over-fitters" because they do a shallow memorization of everything so that they can pass, rather than the true learner who does an in-depth treatment of the course topics that interest them in particular. I'm not sure how to solve this problem.

Comment author: 9eB1 07 January 2015 05:19:38AM 3 points [-]

Regarding "2" the professor can have several very difficult questions and only require a subset of them to be answered. This is often done for essay exams.

Comment author: Luke_A_Somers 07 January 2015 04:15:16PM *  2 points [-]

I've seen it done in math, too.

There was a six question exam, and no one in the class finished more than two problems, and most were only part-way through the second (not the same two problems).

Comment author: IlyaShpitser 07 January 2015 07:07:27PM 1 point [-]

Isn't the median for the Putnam 0?

Comment author: Luke_A_Somers 07 January 2015 08:34:05PM 1 point [-]

Well, yes, but that's not a regular exam, is it?