Dreaded_Anomaly comments on [Link] Why the kids don’t know no algebra - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (165)
Here's the comment I posted on gnxp.
Teacher quality does matter.
From the underlying paper (pdf):
Reading this, two comments occur to me immediately:
Is there a simple explanation of how they estimated the "teacher quality" variable? The paper is written in a very complicated and abstruse way, and I don't have time to wade through it, but surely the basic idea, if valid, should be explicable in a paragraph of plain English.
Even if we take the findings of the paper at face value, the "$100 trillion" estimate is a complete non sequitur. Can the entire effect really be purely because better teachers impart greater wealth-producing skills? Or could it be, at least partly, because they impart advantages in zero-sum signaling and rent-seeking games?
One of the main points of the paper is that typical measures (teacher experience, education, etc.) are not good predictors of quality. The authors spend a lot of time developing a phenomenological model of teacher quality based on comparing student achievement within a school, to reduce the impact of greater variation in populations between schools. From the paper:
This claim is developed in a different paper (linked in the first link I posted), which draws from the paper I linked to discuss teacher quality. Unfortunately, that paper is paywalled, but I have extracted the relevant part, section 4.2, as a pdf (only 2 pages).
They used data comparing performance on math and science tests to economic growth for different countries. They then calculated the improvement in economic growth due to an improvement in student performance from replacing lower-quality teachers with higher-quality teachers. Obviously there is a simplifying assumption of linearity being made for the correlation of test performance and economic growth, and test performance as a measure can fall afoul of Campbell's Law.
Assuming your summary is correct, it would be an insult for the cargo cults to use them as a metaphor for this sort of "science."