gedymin comments on Exams and Overfitting - Less Wrong

12 Post author: robot-dreams 06 January 2015 07:35PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (47)

You are viewing a single comment's thread.

Comment author: gedymin 07 January 2015 10:26:10AM 1 point [-]

I don't think that overfitting is a good metaphor for your problem. Overfitting involves building a model that is more complicated than an optimal model would be. What exactly is the model here, and why do you think that learning just a subset of the course's material leads to building a more complicated model?

Instead, your example looks like a case of sampling bias. Think of the material of whole course as the whole distribution, and of the exam topics as a subset of that distribution. "Training" your brain with samples just from that subset is going to produce a learning outcome that is not likely to work well for the whole distribution.

Memorizing disconnected bits of knowledge without understanding the material - that would be a case of overfitting.

Comment author: TrE 08 January 2015 08:07:24PM 1 point [-]

Memorizing disconnected bits of knowledge without understanding the material - that would be a case of overfitting.

That is exactly what most students do. Source: Am student, have watched others learn.