In Policy Debates Should Not Appear One-Sided, Eliezer Yudkowsky argues that arguments on questions of fact should be one-sided, whereas arguments on policy questions should not:
On questions of simple fact (for example, whether Earthly life arose by natural selection) there's a legitimate expectation that the argument should be a one-sided battle; the facts themselves are either one way or another, and the so-called "balance of evidence" should reflect this. Indeed, under the Bayesian definition of evidence, "strong evidence" is just that sort of evidence which we only expect to find on one side of an argument.
But there is no reason for complex actions with many consequences to exhibit this onesidedness property.
The reason for this is primarily that natural selection has caused all sorts of observable phenomena. With a bit of ingenuity, we can infer that natural selection has caused them, and hence they become evidence for natural selection. The evidence for natural selection thus has a common cause, which means that we should expect the argument to be one-sided.
In contrast, even if a certain policy, say lower taxes, is the right one, the rightness of this policy does not cause its evidence (or the arguments for this policy, which is a more natural expression), the way natural selection causes its evidence. Hence there is no common cause of all of the valid arguments of relevance for the rightness of this policy, and hence no reason to expect that all of the valid arguments should support lower taxes. If someone nevertheless believes this, the best explanation of their belief is that they suffer from some cognitive bias such as the affect heuristic.
(In passing, I might mention that I think that the fact that moral debates are not one-sided indicates that moral realism is false, since if moral realism were true, moral facts should provide us with one-sided evidence on moral questions, just like natural selection provides us with one-sided evidence on the question how Earthly life arose. This argument is similar to, but distinct from, Mackie's argument from relativity.)
Now consider another kind of factual issues: multiple factor explanations. These are explanations which refer to a number of factors to explain a certain phenomenon. For instance, in his book Guns, Germs and Steel, Jared Diamond explains the fact that agriculture first arose in the Fertile Crescent by reference to no less than eight factors. I'll just list these factors briefly without going into the details of how they contributed to the rise of agriculture. The Fertile Crescent had, according to Diamond (ch. 8):
- big seeded plants, which were
- abundant and occurring in large stands whose value was obvious,
- and which were to a large degree hermaphroditic "selfers".
- It had a higher percentage of annual plants than other Mediterreanean climate zones
- It had higher diversity of species than other Mediterreanean climate zones.
- It has a higher range of elevations than other Mediterrenean climate zones
- It had a great number of domesticable big mammals.
- The hunter-gatherer life style was not that appealing in the Fertile Crescent
(Note that all of these factors have to do with geographical, botanical and zoological facts, rather than with facts about the humans themselves. Diamond's goal is to prove that agriculture arose in Eurasia due to geographical luck rather than because Eurasians are biologically superior to other humans.)
Diamond does not mention any mechanism that would make it less likely for agriculture to arise in the Fertile Crescent. Hence the score of pro-agriculture vs anti-agriculture factors in the Fertile Crescent is 8-0. Meanwhile no other area in the world has nearly as many advantages. Diamond does not provide us with a definite list of how other areas of the world fared but no non-Eurasian alternative seem to score better than about 5-3 (he is primarily interested in comparing Eurasia with other parts of the world).
Now suppose that we didn't know anything about the rise of agriculture, but that we knew that there were eight factors which could influence it. Since these factors would not be caused by the fact that agriculture first arose in the Fertile Crescent, the way the evidence for natural selection is caused by the natural selection, there would be no reason to believe that these factors were on average positively probabilistically dependent of each other. Under these conditions, one area having all the advantages and the next best lacking three of them is a highly surprising distribution of advantages. On the other hand, this is precisely the pattern that we would expect given the hypothesis that Diamond suffers from confirmation bias or another related bias. His theory is "too good to be true" and which lends support to the hypothesis that he is biased.
In this particular case, some of the factors Diamond lists presumably are positively dependent on each other. Now suppose that someone argues that all of the factors are in fact strongly positively dependent on each other, so that it is not very surprising that they all co-occur. This only pushes the problem back, however, because now we want an explanation of a) what the common cause of all of these dependencies is (it being very improbable that they all would correlate in the absence of such a common cause) and b) how it could be that this common cause increases the probability of the hypothesis via eight independent mechanisms, and doesn't decrease it via any mechanism. (This argument is complicated and I'd be happy on any input concerning it.)
Single-factor historical explanations are often criticized as being too "simplistic" whereas multiple factor explanations are standardly seen as more nuanced. Many such explanations are, however, one-sided in the way Diamond's explanation is, which indicates bias and dogmatism rather than nuance. (Another salient example I'm presently studying is taken from Steven Pinker's The Better Angels of Our Nature. I can provide you with the details on demand.*) We should be much better at detecting this kind of bias, since it for the most part goes unnoticed at present.
Generally, the sort of "too good to be true"-arguments to infer bias discussed here are strongly under-utilized. As our knowledge of the systematic and predictable ways our thought goes wrong increase, it becomes easier to infer bias from the structure or pattern of people's arguments, statements and beliefs. What we need is to explicate clearly, preferably using probability theory or other formal methods, what factors are relevant for deciding whether some pattern of arguments, statements or beliefs most likely is the result of biased thought-processes. I'm presently doing research on this and would be happy to discuss these questions in detail, either publicly or via pm.
*Edit: Pinker's argument. Pinker's goal is to explain why violence has declined throughout history. He lists the following five factors in the last chapter:
- The Leviathan (the increasing influence of the government)
- Gentle commerce (more trade leads to less violence)
- Feminization
- The expanding (moral) circle
- The escalator of reason
- Weaponry and disarmanent (he claims that there are no strong correlations between weapon developments and numbers of deaths)
- Resource and power (he claims that there is little connection between resource distributions and wars)
- Affluence (tight correlations between affluence and non-violence are hard to find)
- (Fall of) religion (he claims that atheist countries and people aren't systematically less violen
Sorry for following you around so much (I just read this article since you linked to it in our other discussion)
There are two main points, both of which have largely been said or touched on already in your discussion here:
1) When discussing an event or something "playing out," we are talking about a cause and effect. Despite the fact that many things in life have many factors, there are always positive causes for things, which may or may not have counteracting factors. When we want to describe an effect of interest, then the simplest way to do it is to list the cause(s).
2) There are several factors (that I've thought of off the top of my head) that play into what kinds of points you provide when you are presenting a cause/effect relationship:
The first (which DavidAgain mentioned somewhat already) is whether you are trying to describe something that has happened or something that will happen. When we don't know what the outcome of something will be, we must exhaustively weigh all of the factors that we know of and their possible interactions in order to come to the best conclusion about the result. (Really there are two variations on this: what action should be taken vs. what will happen given the current state of the world, but the concept holds in each). If, however, something has already happened, it is reasonable to focus on the causes, A) because we know that they ended up "winning" and B) because there may or may not be negating factors involved in the first place.
If I say something along the lines of "I went swimming today because I was hot," it is not dishonest/biased to refrain from mentioning the fact that I weighed this course of action against several reasons not to do so - the important, primary causation was relayed in the statement and satisfies most people to the extent that they care about the factors involved.
Another factor that might be relevant is how contentious the subject is; even if you are debating something in the past, such as why X happened (or offering a proposal for why X happened), if the conclusion to be drawn is not readily agreed upon then it is prudent to first make sure that all of the relevant facts are presented. On the other hand, if you're trying to teach/explain why something happened in a non-contentious atmosphere, then it may be reasonable to omit facts that are unimportant to maintain coherency and avoid getting bogged down in clutter that doesn't matter to the overarching point. Which category Diamond's book falls under is a bit unclear, but I still am not convinced that it was biased to provide causes without enumerating all of the pros/cons, given that you trust him to the extent that he is telling the truth when we says that the Fertile Crescent was a highly, if not the most advantageous locations for the start of agriculture.
I am on the fence as to whether or not Jared Diamond was slightly biased in this case, but I think it depends on whether you look at his book from the perspective of a comprehensive argument/claim or a proposition of a different mechanism behind how things ended up the way they did which may or may not account for all of history in its complex entirety.
Anyway, I think trying to infer bias based on the presence of pros/cons is a difficult subject. I wouldn't go claiming someone is biased towards something for only presenting a positive message necessarily, even though this is often the case. Even in the example with the teams coming very close to a tie, the response to "why did they win" may have been correct, in that they had all of those factors in their favor and that those were enough to win (barely). I agree that in this case the guy was biased, but on the other hand they didn't ask him "what factors were involved and why did they favor Man City (somewhat)?"
That's about all I'll say for one response - I have a bad tendency of rambling on when I've already made the points that I really wanted to make.
(by the way DavidAgain I loved the way you said the things I was thinking with each consecutive response - I was vicariously participating in the discussion through your comments!)
Firstly, giving reasons for your own choices is something a bit different from explaining events over which you had no control. I'd rather concentrate on the latter cases.
Sure. I do think that Diamond should have provided pros and cons (and Pinker even more so). However, this d... (read more)