NancyLebovitz comments on Open Thread, August 2010-- part 2 - Less Wrong

3 Post author: NancyLebovitz 09 August 2010 11:18PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (369)

You are viewing a single comment's thread.

Comment author: NancyLebovitz 13 August 2010 06:17:30PM 3 points [-]

Problems with high stakes, low quality testing

The percentage of students falling below some arbitrary cutoff is a bad statistic to use for management purposes. (Again, this is Statistical QA 101 stuff.) It throws away information. Worse, it creates perverse incentives, encouraging schools to concentrate on the students performing at around the cut-off level and to neglect both those too far below the threshold to have a chance of catching up and those comfortably above it.