Nisan comments on Open Thread: May 2010, Part 2 - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (348)
I was planning to introduce the topic through a parable of a fictional world carefully crafted not to be directly analogous to any real-world hot-button issues. The parable would be about a hypothetical world where the following facts hold:
A particular fruit X, growing abundantly in the wild, is nutritious, but causes chronical poisoning in the long run with all sorts of bad health consequences. This effect is however difficult to disentangle statistically (sort of like smoking).
Eating X has traditionally been subject to a severe Old Testament-style religious prohibition with unknown historical origins (the official reason of course was that God had personally decreed it). Impoverished folks who nevertheless picked and ate X out of hunger were often given draconian punishments.
At the same time, there has been a traditional belief that if you eat X, you'll incur not just sin, but eventually also get sick. Now, note that the latter part happens to be true, though given the evidence available at the time, a skeptic couldn't tell if it's true or just a superstition that came as a side-effect of the religious taboo. You'd see that poor folks who eat it do get sick more often, but their disease might be just due to poverty, and you'd need sophisticated statistics and controlled studies to tell reliably which way it is.
At a later time, as science progresses and religion withdraws in front of it, and religious figures lose power and prestige, old superstitions and taboos perish, and now defying them is considered more and more cool and progressive. In particular, believing that eating fruit X is bad is now a mark of bigoted fundamentalism. Cool fashionable people will eat X occasionally just to prove a point, historians decry the horrors of the dark ages when poor people were sadistically persecuted for eating it, and a general consensus has been formed that its supposed unhealthiness has never been more than just another religiously motivated superstition. "X-eater" eventually becomes a metaphor for a smart fashionable free-thinker in these people's culture, and "X-phobe" for a bigoted yokel.
People who eat X in significant quantities still get sick more, but the consensus explanation is that it's because, since it's free but not very tasty food, eating it correlates with poverty and thus all sorts of awful living conditions.
Now, notice that in this world, the prevailing normative belief on this issue has moved from draconian religious taboos to a laissez-faire approach, while at the same time, a closely related factual belief has moved significantly away from reality. For all the cruelty of the religious taboo, and the fact that poor folks may well prefer bad health later to starving now, the traditional belief that eating X is bad for your health was factually true. Yet a contrarian scientist who now suggests that this might be true after all will provoke derision and scorn. What is he, one of those crazed fundamentalists who want to bring back the days when poor folks were whipped and pilloried for picking X to feed their starving kids in years of bad harvest?
I think this example would illustrate quite clearly the sort of bias I have in mind. The questions however are:
Does it sound like too close an analogy to some present hot-button issue?
Does the idea that we might be suffering from some analogous biases sound too outlandish? I do believe that many such biases exist in the world today, and I probably myself suffer from some of them, but as you said, taking concrete examples might sound too controversial and polarizing.
I can think of several hot-button issues that are analogous to this parable — or would be, if the parable were modified as follows:
As science progresses, religious figures lose some power and prestige, but manage to hold on to quite a bit of it. Old superstitions and taboos perish at different rates in different communities, and defying them is considered more cool and progressive in some subcultures and cities. Someone will eat fruit X on television and the live audience will applaud, but a grouchy old X-phobe watching the show will grumble about it.
A conference with the stated goal of exploring possible health detriments of X will attract people interested in thinking rationally about public health, as well as genuine X-phobes. The two kinds of people don't look any different.
The X-phobes pick up science and rationality buzzwords and then start jabbering about the preliminary cherrypicked scientific results impugning X, with their own superstition and illogical arguments mixed in. Twentysomething crypto-X-phobes seeking to revitalize their religion now claim that their religion is really all about protecting people from the harms of X, and feed college students subtle misinterpretations of the scientific evidence. In response to all this, Snopes.com gets to work discrediting any claim of the form "X is bad". The few rational scientists studying the harmfulness of X are shunned by their peers.
What's a rationalist to do? Personally, whenever I hear someone say "I think we should seriously consider the possibility that such-and-such may be true, despite it being politically incorrect", I consider it more likely than not that they are privileging the hypothesis. People have to work hard to convince me of their rationality.
Yes, that would certainly make the parable much closer to some issues that other people have already pointed out! However, you say:
Well, if the intellectual standards in the academic mainstream of the relevant fields are particularly low, and the predominant ideological biases push very strongly in the direction of the established conclusion that the contrarians are attacking, the situation is, at the very least, much less clear. But yes, organized groups of contrarians are often motivated by their own internal biases, which they constantly reinforce within their peculiar venues of echo-chamber discourse. Often they even develop some internal form of strangely inverted political correctness.
Moreover, my parable assumes that there are still non-trivial lingering groups of X-phobe fundamentalists when the first contrarian scientists appear. But what if the situation ends up with complete extirpation of all sorts of anti-X-ism, and virtually nobody is left who supports it any more, long before statisticians in this hypothetical world figure out the procedures necessary to examine the issue correctly? Imagine anti-X-ism as a mere remote historical memory, with no more supporters than, say, monarchism in the U.S. today. The question is -- are there any such issues today, where past beliefs have been replaced by inaccurate ones that it doesn't even occur to anyone any more to question, not because it would be politically incorrect, but simply because alternatives are no longer even conceivable?