Both the government and the public should be far more sceptical about policies which are purported to be ‘evidence-based’, argues new research released today by the Institute of Economic Affairs.
In Quack Policy – Abusing Science in the Cause of Paternalism, Jamie Whyte exposes how politicians promote regulations and taxes under the justification of scientific evidence, yet the experts promoting these policies often make basic errors and have little or no grasp of economics.
http://www.iea.org.uk/in-the-media/press-release/%E2%80%98evidence-based%E2%80%99-policies-are-damaging-uk-policymaking
Those in favour of evidenced based policies have tended to be dismissive, arguing that this is just a case of lack of evidence, rather than a problem with evidence-based policies per se.
https://twitter.com/bengoldacre/status/370159847985381376
I'm not fully convinced though. I've started reading Taking the medicine: a short history of medicine's beautiful idea and our difficulty swallowing it by Druin Burch, and this has plenty of examples of people saying something like "Of course, up till now medicine has been totally wrong, but I've got a new way of doing it right" - and then going on to make the same old mistakes. Maybe evidence based practice is the same, just a way of convincing ourselves that we've got it right this time.
As I see it, the trouble with evidence based practice is that what counts as evidence based today doesn't meet tomorrows higher standards. This means
- How can we trust evidence based practice if it might be overturned tomorrow?
- As less gets to count as evidence, evidence based practice gets harder and harder to do.
At the root of this is the insistence that evidence must meet some 'gold standard'. This seems to be too much the frequentist viewpoint, but in the end we have to be Bayesians, taking all evidence into account.
As I see it the question isn't so much about elites and non-elites, but about problem solvers and storytellers. Storytellers give you a reason to want to cross the ocean, problem solvers make sure that you have boat that doesn't sink. Much of the internet is populated by storytellers - someone might do a lot of problem solving in their day job, and then write stories about it in a blog.
MathOverflow, the top site cited as what Less Wrong should be aiming for, is very much about problem solving - you post a problem and can hope to get an answer from some really bright people within a couple of hours. But Jonah Sinick asked why more winners of mathematical prizes don't post their thoughts for all to see - well maybe that isn't the way to win prizes.
It's hard to see where Less Wrong fits into this division. One would think that rationality would be about getting away from the stories that we have been told and getting down to problem solving - new ways to deal with akrasia, poverty or death. Less Wrong looks like it ought to be the public (i.e. storytelling) face of an enterprise which goes in for such problem solving - that is what internet forums often are. But when you dig deeper, you just tend to find more storytelling. I would guess that Elizier has excellent problem solving skills, but the Elizier we see is very much a storyteller.
In the end it's hard to see what Less Wrong is about. Informal discussion is all very well, but to get more interest from elsewhere it needs more of a sense of focus - what sort of problems should we be looking at and what is being done to tackle them.