Douglas, with regard to systematic but unexplained errors, would you agree that we can (usually) describe these as due to unidentified heuristics? I'm feeling very unsure about that, but I would like to have some fairly concrete way of thinking about this blog's subject matter, and at least this way it's something I've taught. :-) I'm not about to insist that all thought can be modeled with symbol-processing. It may even be that the most fundamental errors are those that arise without any symbol-processing -- I've just been reading a dog-trainer's book which emphasizes the errors we make in dealing with our dogs, simply because we automatically do what other primates do even when we've verbally worked it out. Still, by the time you get to correcting a bias found in less-obviously-symbolic process, say a neural net or genetic learning-algorithm, I think you're describing that bias and its correction via rules on patterns of symbols -- and that's the way I've been seeing this blog. (Is everybody asleep yet? Well, I suspect this thread was drying up anyway -- as you can see, I have a bias in favor of mixed metaphors.)
Douglas and g both respond in terms of cost, apparently agreeing that the value of bias-correction (in any given context) will be limited, and it may not be the best use of whatever resources you've got...this again seems Cowenesque to me, and I'm reasonably happy with it; we have few absolutes showing except for (a) HA's survival (which I tentatively rate as a rhetorical position, unlikely to show itself in HA's real-world behavior), and (b) anti-torture.
I was going to leave the torture theme strictly alone because I've never seen it come to any good end, but maybe it's worth saying: when you say you're "against torture", you haven't actually told me much at all because too many people mean too many things by "torture". In a blog post apparently dedicated to clarity, I think that's extraordinarily important.
Let me clarify: consider a long interrogation under bright lights when you want to sleep; is that torture? Some will very sincerely say yes, some will very sincerely (I believe) say no, and some will draw the line at some specific number of hours of sleep-deprivation. If someone opposes more than 10 hours as "torture", and you oppose more than 5 hours as "torture", you can class them as "pro-torture" but it strikes me as an anti-clarity sort of rhetorical move. Is (fake? real?) menstrual blood-smearing torture? Again, apparently sincere disagreement exists. Is (some specific kind of) fraternity hazing torture? Is boot camp torture? Do I have an opinion on any of those? Not really: my primary torture stance is not anti-torture or pro-torture, it's pro-clarity.
Specifically, I would focus on interrogation -- trying to get leave out O'Brien and Winston, just as I would leave out Saddam's people-shredders, on the grounds that the purposes involved are not obviously those of "enhanced interrogation" -- O'Brien isn't at that point looking for information, he's destroying Winston prior to execution for reasons I've never understood, but which I suspect the pyramid-of-prisoners people understood perfectly well; it has something to do with dominance. (Yes?) And I would not start out with rules that say "10 hours yes, 11 hours no" or "uncomfortable chair yes, stress position no". I would not even start out with a rule against waterboarding. I would start out with a rule that says that (1) interrogation should always be on video, that (2) any sequence of interrogation techniques (insults? lights? Madonna videos? waterboarding?) should be precisely described, that (3) any interrogator should have previously undergone any technique he or she applies on a publicly-available "licensing video", that (4) the interrogation video should immediately begin a chain of viewings and authorizations which ends with actual publication no more than N years (10?) later. I could go on about what I mean by "precisely described" and how the authorizers would be authorized and all that, but I suspect that (a) most people who describe themselves as "anti-torture" are, by now, angry, even though (b) any such pro-clarity rule would end up ruling out whatever it is that ordinary people think of as torture, while allowing the anti-torture people a maximal opportunity to explain specifically what they meant and why all of these (or all but X, Y, and Z) should be outlawed. So...gee. Am I biased in favor of clarity? Yes, but only to a limited extent. And I'm glad to learn from people who are biased against bias more than I am, especially if I can figure out what they mean.
George Orwell saw the descent of the civilized world into totalitarianism, the conversion or corruption of one country after another; the boot stamping on a human face, forever, and remember that it is forever. You were born too late to remember a time when the rise of totalitarianism seemed unstoppable, when one country after another fell to secret police and the thunderous knock at midnight, while the professors of free universities hailed the Soviet Union’s purges as progress. It feels as alien to you as fiction; it is hard for you to take seriously. Because, in your branch of time, the Berlin Wall fell. And if Orwell’s name is not carved into one of those stones, it should be.
Orwell saw the destiny of the human species, and he put forth a convulsive effort to wrench it off its path. Orwell’s weapon was clear writing. Orwell knew that muddled language is muddled thinking; he knew that human evil and muddled thinking intertwine like conjugate strands of DNA:1
Orwell was clear on the goal of his clarity:
To make our stupidity obvious, even to ourselves—this is the heart of Overcoming Bias.
Evil sneaks, hidden, through the unlit shadows of the mind. We look back with the clarity of history, and weep to remember the planned famines of Stalin and Mao, which killed tens of millions. We call this evil, because it was done by deliberate human intent to inflict pain and death upon innocent human beings. We call this evil, because of the revulsion that we feel against it, looking back with the clarity of history. For perpetrators of evil to avoid its natural opposition, the revulsion must remain latent. Clarity must be avoided at any cost. Even as humans of clear sight tend to oppose the evil that they see; so too does human evil, wherever it exists, set out to muddle thinking.
1984 sets this forth starkly: Orwell’s ultimate villains are cutters and airbrushers of photographs (based on historical cutting and airbrushing in the Soviet Union). At the peak of all darkness in the Ministry of Love, O’Brien tortures Winston to admit that two plus two equals five:2
I am continually aghast at apparently intelligent folks—such as Robin Hanson’s colleague Tyler Cowen—who don’t think that overcoming bias is important.3 This is your mind we’re talking about. Your human intelligence. It separates you from an orangutan. It built this world. You don’t think how the mind works is important? You don’t think the mind’s systematic malfunctions are important? Do you think the Inquisition would have tortured witches, if all were ideal Bayesians?
Tyler Cowen apparently feels that overcoming bias is just as biased as bias: “I view Robin’s blog as exemplifying bias, and indeed showing that bias can be very useful.” I hope this is only the result of thinking too abstractly while trying to sound clever. Does Tyler seriously think that scope insensitivity to the value of human life is on the same level with trying to create plans that will really save as many lives as possible?
Orwell was forced to fight a similar attitude—that to admit to any distinction is youthful naiveté:
Maybe overcoming bias doesn’t look quite exciting enough, if it’s framed as a struggle against mere accidental mistakes. Maybe it’s harder to get excited if there isn’t some clear evil to oppose. So let us be absolutely clear that where there is human evil in the world, where there is cruelty and torture and deliberate murder, there are biases enshrouding it. Where people of clear sight oppose these biases, the concealed evil fights back. The truth does have enemies. If Overcoming Bias were a newsletter in the old Soviet Union, every poster and commenter of Overcoming Bias would have been shipped off to labor camps.
In all human history, every great leap forward has been driven by a new clarity of thought. Except for a few natural catastrophes, every great woe has been driven by a stupidity. Our last enemy is ourselves; and this is a war, and we are soldiers.
1George Orwell, “Politics and the English Language,” Horizon, 1946.
2George Orwell, 1984 (Signet Classic, 1950).
3See Tyler Cowen, “How Important is Overcoming Bias?,” Marginal Revolution (blog), 2007, http://marginalrevolution.com/marginalrevolution/2007/08/how-important-i.html.