Ambiguity in cognitive bias names; a refresher

nerfhammer

This came on the nyc list, I thought I would adapt it here.

Cognitive biases have names. That's what makes them memetic. It's easier to think about something that has a name. Though I think the benefits outweigh the costs, there is also the risk of a little Albert: a concept living on after the original research has been found to be much more ambiguous than first realized.

There are many errors that are possible with respect to named ideas, and despite being studied generally scientifically, cognitive biases are no exception. There is no equivalent to cognitive biases as the Académie Française is to French.

Let's describe some. Here they are:

different people in different fields will "discover" virtually the same bias but not be aware of each other and assign it different names. For example, see the Curse of Knowledge which I think George Loewenstein came up with vs. the Historian's Fallacy by David Hackett Fischer, presentist bias, creeping determinism, and probably many others, not all of them scientific. Sometimes researchers in seemingly closely related subfields are remarkably insular to each other.
researchers will use one term predominantly while an offshoot will decide they don't like the name and use a different one. For example the Fundamental Attribution Error has also been called the overattribution effect, the correspondence bias, the attribution bias, and the actor-observer effect. In this case the older term still predominates, and is used in intro textbooks without asterisks. Of the naming errors this is one of the least harmful, since everyone agrees what the FAE is, some just prefer a different name for it.
an author will decide he doesn't like the names of some biases will invent idiosyncratic names of his own. Jonathan Baron has a good textbook on cognitive bias but he uses names of his own invention half the time.
the same term will sometimes have different polysemous meanings. For example the "Zeigarnik Effect" has been used to refer to a memory bias in having a superior recall for unfinished tasks, and the term has also been used to refer to an attentional bias in which unfinished tasks tend intrude on consciousness; almost, but not quite exactly, the same thing. The term "confirmation bias" has several different but related meanings, for example, to seek out confirming information, to notice confirming information, to ask confirming questions, etc. which are not all quite exactly the same thing. The different meanings may have completely different contexts, boundary conditions etc., leading to confusion. Furthermore some of the senses may be at least partially disproven but not necessarily others, for example, the tendency to ask confirming questions has turned out to be more complicated than once thought. You might never know from reading about the attentional Zeigarnik that there is also a memory Zeiganik effect that is conceptually somewhat different. I recall seeing even prominent researchers occasionally making mistakes of this category. Of all the naming ambiguities I think is the most dangerous.
an offshoot of researchers may knowingly use the same term with a conflicting definition. For example "heuristic" in "Heuristics and Biases" versus "Fast and Frugal Heuristics", the latter of which was an intentional reaction to the former. In this case those involved know there is a disagreement in meaning, but those unfamiliar to the topic might be confused.[This is a point of contention which I'm willing to yield on]
the same term may be redefined by researchers who may not aware of each other. There has been more than one paper trying to introduce a bias to call "the disconfirmation effect". But this only happens for really obscure biases.
a bias may have different components which do not have names of their own and/or a bias may overlap partially but not completely with another bias. For instance, hindsight bias has different components one of which has some overlap with the curse of knowledge.
the same bias term will be used as a rough category of experimental effect and also as a singular bias. For example, the term "an actor-observer bias" could refer to any difference in actors and observers, whereas "the actor-observer bias" refers to the Fundamental Attribution Error specifically; the same is true of "an" vs. "the" attribution bias, also referring to the FAE. This could confuse only those who are unfamiliar with the terminology.
sometimes authors have tried to enforce strict, distinct meanings for the subterms "bias" vs. "effect" vs. "neglect" vs. "error" or "fallacy"; other times, perhaps more often, these terms are used only by convention. For example the conjunction fallacy vs. the conjunction error, correspondence bias vs. the fundamental attribution error, base rate neglect vs. base rate error. Sometimes the originators of a bias try to use the terminology precisely while later authors citing it aren't as careful. Sometimes even the originators of a bias do not try to choose a subterm carefully. You might suspect what permutation of a term catches on is based on whichever has a better ring to it.

This came on the nyc list, I thought I would adapt it here.

Let's describe some. Here they are:

different people in different fields will "discover" virtually the same bias but not be aware of each other and assign it different names. For example, see the Curse of Knowledge which I think George Loewenstein came up with vs. the Historian's Fallacy by David Hackett Fischer, presentist bias, creeping determinism, and probably many others, not all of them scientific. Sometimes researchers in seemingly closely related subfields are remarkably insular to each other.
researchers will use one term predominantly while an offshoot will decide they don't like the name and use a different one. For example the Fundamental Attribution Error has also been called the overattribution effect, the correspondence bias, the attribution bias, and the actor-observer effect. In this case the older term still predominates, and is used in intro textbooks without asterisks. Of the naming errors this is one of the least harmful, since everyone agrees what the FAE is, some just prefer a different name for it.
an author will decide he doesn't like the names of some biases will invent idiosyncratic names of his own. Jonathan Baron has a good textbook on cognitive bias but he uses names of his own invention half the time.
the same term will sometimes have different polysemous meanings. For example the "Zeigarnik Effect" has been used to refer to a memory bias in having a superior recall for unfinished tasks, and the term has also been used to refer to an attentional bias in which unfinished tasks tend intrude on consciousness; almost, but not quite exactly, the same thing. The term "confirmation bias" has several different but related meanings, for example, to seek out confirming information, to notice confirming information, to ask confirming questions, etc. which are not all quite exactly the same thing. The different meanings may have completely different contexts, boundary conditions etc., leading to confusion. Furthermore some of the senses may be at least partially disproven but not necessarily others, for example, the tendency to ask confirming questions has turned out to be more complicated than once thought. You might never know from reading about the attentional Zeigarnik that there is also a memory Zeiganik effect that is conceptually somewhat different. I recall seeing even prominent researchers occasionally making mistakes of this category. Of all the naming ambiguities I think is the most dangerous.
an offshoot of researchers may knowingly use the same term with a conflicting definition. For example "heuristic" in "Heuristics and Biases" versus "Fast and Frugal Heuristics", the latter of which was an intentional reaction to the former. In this case those involved know there is a disagreement in meaning, but those unfamiliar to the topic might be confused.[This is a point of contention which I'm willing to yield on]
the same term may be redefined by researchers who may not aware of each other. There has been more than one paper trying to introduce a bias to call "the disconfirmation effect". But this only happens for really obscure biases.
a bias may have different components which do not have names of their own and/or a bias may overlap partially but not completely with another bias. For instance, hindsight bias has different components one of which has some overlap with the curse of knowledge.
the same bias term will be used as a rough category of experimental effect and also as a singular bias. For example, the term "an actor-observer bias" could refer to any difference in actors and observers, whereas "the actor-observer bias" refers to the Fundamental Attribution Error specifically; the same is true of "an" vs. "the" attribution bias, also referring to the FAE. This could confuse only those who are unfamiliar with the terminology.
sometimes authors have tried to enforce strict, distinct meanings for the subterms "bias" vs. "effect" vs. "neglect" vs. "error" or "fallacy"; other times, perhaps more often, these terms are used only by convention. For example the conjunction fallacy vs. the conjunction error, correspondence bias vs. the fundamental attribution error, base rate neglect vs. base rate error. Sometimes the originators of a bias try to use the terminology precisely while later authors citing it aren't as careful. Sometimes even the originators of a bias do not try to choose a subterm carefully. You might suspect what permutation of a term catches on is based on whichever has a better ring to it.

Have to disagree with you on, well, several points here.

Heuristics in Heuristics and Biases are only descriptive. [...] Heuristics in Heuristics and biases are defined as having negative side effects.

If your claim is that heuristics are defined by H&B theorists as being explicitly not prescriptive, in the sense of never being "good" or "useful," this is simply not the case. For instance, in the opening paragraph of their seminal 1974 Science article, Kahneman & Tversky clearly state that "...people rely on a limited number of heuristic principles which reduce the complex tasks of assessing probabilities and predicting values to simpler judgmental operations. In general, these heuristics are quite useful, but sometimes they lead to severe and systematic errors." Gigerenzer et al. would not necessarily disagree with this definition (they tend to define heuristics in terms of "ignoring information" rather than "reducing complexity," although the end result is much the same), although they would almost certainly phrase it in a more optimistic way.

...nor probably could you even if you tried. You could not intentionally reproduce the pattern of cognitive biases that their heuristics allegedly cause, many appear to be irretrievably outside of conscious awareness or control.

Representativeness, one of the earliest examples of a heuristic given by the H&B program, is certainly used in a conscious and deliberate way. When asked, subjects routinely report relying on representativeness to make frequency or probability judgments, and they generally see nothing wrong or even really remarkable about this fact. Nick Epley's work also strongly suggests that people very deliberately rely on anchoring-and-adjustment strategies when making some common judgments (e.g., "When was George Washington elected president?" "Hmm, well it was obviously some time shortly after the Declaration of Independence, which was in 1776... so maybe 1786?").

Fast and Frugal heuristics, however, you can learn and use intentionally.

One can certainly learn to use any heuristic strategy, but for some heuristics proposed by the F&F camp, such as the so-called fluency heuristic (Hertwig et al., 2008), it is not at all obvious that in practice they are utilized in any intentional way, or even that subjects are aware of using them. The fluency heuristic in particular is extremely similar to the availability heuristic proposed decades earlier by Kahneman & Tversky.

Descriptive F&F heuristics aren't evolutionary quirks.

I'm not sure what you mean here. If an "evolutionary quirk" is a locally optimal solution that falls short of a global maximum, then the heuristics described by both H&B and F&F theorists are most certainly "evolutionary quirks." The claim being advanced by F&F theorists is not that the heuristics we tend to use are optimal in any sense of having maximal evolutionary adaptedness, but simply that they work just fine thanks. Note, however, that they are outperformed in simple inference tasks even by relatively simple strategies like multiple regression, and outperformed in more challenging prediction tasks by, e.g., Bayes Nets. They are decidedly not globally optimal.

...besides the obvious that Fast and Frugal heuristics are "good" while heuristics as in Heuristics and biases are "bad".

This impression is entirely due to differences in the framing and emphasis employed by the two camps. It does not represent anything like a fundamental distinction between how they each view the nature or role of heuristics in judgment and decision making.

Heuristics in Heuristics and Biases are only descriptive. [...] Heuristics in Heuristics and biases are defined as having negative side effects.

If your claim is that heuristics are defined by H&B theorists as being explicitly not prescriptive, in the sense of never being "good" or "useful," this is simply not the case.

No, no, that's not what I'm saying. The claim that heuristics have negative side effects does not entail a claim that negative side effects are the only characteristics they have. The 'side effect' terminology mi... (read more)

39

Ambiguity in cognitive bias names; a refresher

39

39

39

Ambiguity in cognitive bias names; a refresher

39

39