kalium comments on Advanced Placement exam cutoffs and superficial knowledge over deep knowledge - Less Wrong

4 Post author: JonahSinick 01 September 2013 09:01PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (18)

You are viewing a single comment's thread.

Comment author: kalium 05 September 2013 06:19:07PM *  0 points [-]

"Performing at the 90% level" doesn't mean anything unless you assume that the questions are precisely calibrated so that someone with a good understanding of the material will get about 90% of the questions right in the allowed amount of time. While this is very common in high school, in my five years of college I never took a class that used this scale. Why should you assign problems so easy that someone with almost no grasp of the material gets 60% of them right (D) and a decently smart person who studies a lot can be assured of 100% (A+)?

The question you should be asking is "Is it possible to get the percentage needed for a 5 without a good understanding of the subject?" An exam with five truly difficult problems, where you get a 5 if even one is fully solved, would be a good exam by this standard despite looking very bad by the standard you are using.

I agree that AP exams are often too easy and do not require a good understanding of the material, but

I was very surprised that I scored a 5 (the top mark), because at the time when I took the exam, I didn't know some very basic things that were on the syllabus.

is the only thing in your whole post that's really relevant to this.

Comment author: JonahSinick 05 September 2013 07:01:30PM 1 point [-]

I agree that AP exams are often too easy and do not require a good understanding of the material, but [...] is the only thing in your whole post that's really relevant to this.

I also wrote:

"On an object level, based on my experience taking the AP calculus exams as a high schooler, my experience teaching calculus for three years at University of Illinois, and my revisiting the exams, I think that students who score 90% on an AP calculus exam know the material very well, and that students who score 63% (the lowest percentage needed to get a 5) have only marginal knowledge of the material."