paper-machine comments on Problems in Education - Less Wrong Discussion
You are viewing a comment permalink. View the original post to see all comments and the full post content.
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (318)
They control for schools opting not to participate; see the section under substitute schools.
It's standard research ethics that minors (and their guardians) be given the option to refuse to participate in a study.
Now I'm confused. The original inference Sailer drew from PISA was that American students outperform their racial group in other countries. You're claiming the study will be biased against white Americans. If anything you should be annoyed at Sailer for trying to support his racial performance narrative using a study that didn't really focus on it.
Regarding homeschooling in particular, it'd be nearly impossible to develop an international study on the same scale of PISA (which you already want to reject as too small) merely because homeschooling isn't prevalent in most of the PISA-participating countries.
I'm aware that they tried to control, but the bounds are large and open to exploitation by the countries who so choose to do so.
And the homeschool issue should strengthen his conclusion. I was just noting a factor he hadn't controlled for.
Both factors I pointed to would tend to mean that the relative rank for the US is in reality better than listed, IMO, but the wide bounds of substitution adjustment makes it very hard to be confident in the results.