Ambiguity in cognitive bias names; a refresher

25 nerfhammer 21 February 2012 04:37AM

This came on the nyc list, I thought I would adapt it here.

Cognitive biases have names. That's what makes them memetic. It's easier to think about something that has a name. Though I think the benefits outweigh the costs, there is also the risk of a little Albert: a concept living on after the original research has been found to be much more ambiguous than first realized.

There are many errors that are possible with respect to named ideas, and despite being studied generally scientifically, cognitive biases are no exception. There is no equivalent to cognitive biases as the Académie Française is to French.

Let's describe some. Here they are:

  • different people in different fields will "discover" virtually the same bias but not be aware of each other and assign it different names. For example, see the Curse of Knowledge which I think George Loewenstein came up with  vs. the Historian's Fallacy by David Hackett Fischer, presentist bias, creeping determinism, and probably many others, not all of them scientific. Sometimes researchers in seemingly closely related subfields are remarkably insular to each other. 
  • researchers will use one term predominantly while an offshoot will decide they don't like the name and use a different one. For example the Fundamental Attribution Error has also been called the overattribution effect, the correspondence bias, the attribution bias, and the actor-observer effect. In this case the older term still predominates, and is used in intro textbooks without asterisks. Of the naming errors this is one of the least harmful, since everyone agrees what the FAE is, some just prefer a different name for it.
  • an author will decide he doesn't like the names of some biases will invent idiosyncratic names of his own. Jonathan Baron has a good textbook on cognitive bias but he uses names of his own invention half the time.
  • the same term will sometimes have different polysemous meanings. For example the "Zeigarnik Effect" has been used to refer to a memory bias in having a superior recall for unfinished tasks, and the term has also been used to refer to an attentional bias in which unfinished tasks tend intrude on consciousness; almost, but not quite exactly, the same thing. The term "confirmation bias" has several different but related meanings, for example, to seek out confirming information, to notice confirming information, to ask confirming questions, etc. which are not all quite exactly the same thing. The different meanings may have completely different contexts, boundary conditions etc., leading to confusion. Furthermore some of the senses may be at least partially disproven but not necessarily others, for example, the tendency to ask confirming questions has turned out to be more complicated than once thought. You might never know from reading about the attentional Zeigarnik that there is also a memory Zeiganik effect that is conceptually somewhat different. I recall seeing even prominent researchers occasionally making mistakes of this category. Of all the naming ambiguities I think is the most dangerous.
  • an offshoot of researchers may knowingly use the same term with a conflicting definition. For example "heuristic" in "Heuristics and Biases" versus "Fast and Frugal Heuristics", the latter of which was an intentional reaction to the former. In this case those involved know there is a disagreement in meaning, but those unfamiliar to the topic might be confused.[This is a point of contention which I'm willing to yield on]
  • the same term may be redefined by researchers who may not aware of each other. There has been more than one paper trying to introduce a bias to call "the disconfirmation effect". But this only happens for really obscure biases.
  • a bias may have different components which do not have names of their own and/or a bias may overlap partially but not completely with another bias. For instance, hindsight bias has different components one of which has some overlap with the curse of knowledge. 
  • the same bias term will be used as a rough category of experimental effect and also as a singular bias. For example, the term "an actor-observer bias" could refer to any difference in actors and observers, whereas "the actor-observer bias" refers to the Fundamental Attribution Error specifically; the same is true of "an" vs. "the" attribution bias, also referring to the FAE. This could confuse only those who are unfamiliar with the terminology.
  • sometimes authors have tried to enforce strict, distinct meanings for the subterms "bias" vs. "effect" vs. "neglect" vs. "error" or "fallacy"; other times, perhaps more often, these terms are used only by convention. For example the conjunction fallacy vs. the conjunction error, correspondence bias vs. the fundamental attribution error, base rate neglect vs. base rate error. Sometimes the originators of a bias try to use the terminology precisely while later authors citing it aren't as careful. Sometimes even the originators of a bias do not try to choose a subterm carefully. You might suspect what permutation of a term catches on is based on whichever has a better ring to it.
Comment author: Normal_Anomaly 06 December 2011 09:43:16PM 6 points [-]

As a teenager I trained myself to recognize specific small details that reliably distinguish between otherwise similar-looking expressions; tightened muscles, gaze direction, shoulder height and angle, things like that.

Could you do a discussion post on this? It would really help me.

Comment author: nerfhammer 19 December 2011 08:16:06AM 0 points [-]
Comment author: michaelcurzi 03 October 2011 03:18:55AM 0 points [-]

All of the above, I'd just install some basic set of sharing buttons. Email, twitter, facebook, maybe Google+.

Comment author: nerfhammer 03 October 2011 03:33:41PM 0 points [-]

I've re-instated twitter so far. The issues are: general visual clutter, I found a way to mitigate this issue by using a trick to force lower the visual contrast of the buttons, and that these social buttons often really slow down the loading of the page, especially if you want the dynamic share/like/retweet counters for every item. I might leave the counter on twitter but omit it for the others and see what the page load is like.

I'm not sure what email-sharing service to use... facebook has one in its "share" button, there are probably others.

Comment author: djcb 02 October 2011 06:08:32PM 0 points [-]

I like it! Thanks for providing this.

Only minor quibble is the fact that some of the blogs only put a short snippet in their RSS-feed. As I like reading things in a feed-reader (actually, feed2imap + my e-mail client), having to open a browser to read things is small nuisance.

So, as a small feature request, maybe offer a way to filter the feeds to only get the ones that have the full text in their feed?

Comment author: nerfhammer 03 October 2011 03:26:40PM *  1 point [-]

I've thought of ways of working around this. There are ways of actually defeating the truncation. One issue is that there isn't necessarily an obvious programmatic way of telling which feeds are truncated and which aren't.

For now, try out this feed proxy: http://andrewtrusty.appspot.com/readability/ , e.g. http://andrewtrusty.appspot.com/readability/feed?url=http%3A//feeds.feedburner.com/planetrationalist

Comment author: michaelcurzi 30 September 2011 07:22:06PM 0 points [-]

Sweet. I endorse you doing things. You need share buttons - I want to be able to send these articles out or tweet them with a click.

Comment author: nerfhammer 30 September 2011 08:20:55PM 0 points [-]

Hmm, I was wondering how much people used those things. Do you want just twitter + email? Facebook?

Comment author: FiftyTwo 30 September 2011 05:03:37PM 0 points [-]

Very interesting, I suspect I will spend a lot of time reading this.

How are you defining rationalist for these purposes? How are you selecting the blogs?

Comment author: nerfhammer 30 September 2011 06:37:43PM *  0 points [-]

To be completely honest, I wasn't going on a strict definition of the term rationalist; frankly I consider the term kind of flawed anyway. But I don't have a better replacement in mind. For me it means being interested in being rational, being interested in how the mind works, being interested in cognitive biases, Bayes' rule, probability, statistics, logical fallacies, and scientific self-improvement.

  • I selected the sources starting with lesswrong and overcoming bias, then taking suggestions from people, doing some rudimentary graph analysis, manually adding blogs of authors in related fields, watching what sources I selected linked to themselves.
  • I tried to include sources that were readable but not gimmicky (e.g. top 7 secret tips to supercharge your goals!!!). Sometimes sources vary outside this interval, and I don't have any filtration sophisticated enough to handle this.
  • I selected against sources that posted too frequently, anything political, anything that seemed angry or upbraiding or read like a manifesto. I included some sources which include these but against which I was able to filter out the political etc. posts easily. The rudimentary methods I used to filter topics doesn't work perfectly, though.
  • I tried to include a few sources from less closely related subjects that were high quality and don't seem to post that frequently. For instance, I included only a couple skeptic blogs, but there are tons and tons of them out there and I feel that it's a different niche that's already addressed pretty well elsewhere. Some fields I avoided almost entirely like entrepreneurship or economics.
  • I tried to not let any one subject dominate the set of sources. I feel like I included too many psychology blogs, for example.
Comment author: curiousepic 30 September 2011 05:53:05PM 0 points [-]

Yes.

Comment author: nerfhammer 30 September 2011 06:13:41PM 1 point [-]

Options for now:

  • create a greasemonkey script to hide posts from the sources you don't want. Every source has a unique CSS class so it should be trivial.
  • create a yahoo pipe to filter the sources you don't want through the rss feed and read it through a feed reader
  • clone the set of sources using the OPML feed in your feed reader of choice and add/remove whatever you want from the source list. However, this will not be kept in sync in the likely event that the official set of sources should change.

Out of curiosity, what don't you want to see and why?

Comment author: curiousepic 30 September 2011 03:35:46PM 2 points [-]

Any hope of toggleable sources?

Comment author: nerfhammer 30 September 2011 04:11:39PM 0 points [-]

Meaning you want to turn some sources off?

Comment author: Dreaded_Anomaly 29 September 2011 10:53:28PM 0 points [-]

I am impressed. (I would be marginally more impressed if the site gained a favicon.)

Comment author: nerfhammer 30 September 2011 02:20:39PM 0 points [-]

Yeah I couldn't think of one.

Favicon contest?

Comment author: shokwave 30 September 2011 12:12:26AM 0 points [-]

I suggest the Google Chrome default favicon with a big coloured R in the middle.

Comment author: nerfhammer 30 September 2011 02:19:07PM *  0 points [-]

View more: Prev | Next