You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

gedymin comments on Exams and Overfitting - Less Wrong Discussion

12 Post author: robot-dreams 06 January 2015 07:35PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (47)

You are viewing a single comment's thread.

Comment author: gedymin 07 January 2015 10:26:10AM 1 point [-]

I don't think that overfitting is a good metaphor for your problem. Overfitting involves building a model that is more complicated than an optimal model would be. What exactly is the model here, and why do you think that learning just a subset of the course's material leads to building a more complicated model?

Instead, your example looks like a case of sampling bias. Think of the material of whole course as the whole distribution, and of the exam topics as a subset of that distribution. "Training" your brain with samples just from that subset is going to produce a learning outcome that is not likely to work well for the whole distribution.

Memorizing disconnected bits of knowledge without understanding the material - that would be a case of overfitting.

Comment author: TrE 08 January 2015 08:07:24PM 1 point [-]

Memorizing disconnected bits of knowledge without understanding the material - that would be a case of overfitting.

That is exactly what most students do. Source: Am student, have watched others learn.