Elqayam & Evans (2011) argue against a certain kind of normativism about rationality

lukeprog

A forthcoming edition of Behavioral and Brain Sciences will be devoted to Elqayam & Evans' (2011) critique of normativism about rationality and brief responses to it.

Abstract:

We propose a critique of normativism, defined as the idea that human thinking reflects a normative system against which it should be measured and judged. We analyze the methodological problems associated with normativism, proposing that it invites the controversial is-ought inference, much contested in the philosophical literature. This problem is triggered when there are competing normative accounts (the arbitration problem), as empirical evidence can help arbitrate between descriptive theories, but not between normative systems. Drawing on linguistics as a model, we propose that clear distinction between normative systems and competence theories is essential, arguing that equating them invites an ‘is-ought’ inference; to wit, supporting normative ‘ought’ theories with empirical ‘is’ evidence. We analyze in detail two research programs with normativist features, Oaksford and Chater’s rational analysis, and Stanovich and West’s individual differences approach, demonstrating how in each case equating norm and competence leads to an is-ought inference. Normativism triggers a host of research biases in psychology of reasoning and decision making:focusing on untrained participants and novel problems, analyzing psychological processes in terms of their normative correlates, and neglecting philosophically significant paradigms when they do not supply clear standards for normative judgment. For example, in a dual-process framework, normativism can lead to a fallacious ‘ought-is’ inference, in which normative responses are taken as diagnostic of analytic reasoning. We propose that little can be gained from normativism that cannot be achieved by descriptivist computational-level analysis, illustrating our position with Hypothetical Thinking Theory and the theory of the suppositional conditional. We conclude that descriptivism is a viable option, and that theories of higher mental processing would be better off freed from normative considerations.

A forthcoming edition of Behavioral and Brain Sciences will be devoted to Elqayam & Evans' (2011) critique of normativism about rationality and brief responses to it.

Abstract:

We propose a critique of normativism, defined as the idea that human thinking reflects a normative system against which it should be measured and judged. We analyze the methodological problems associated with normativism, proposing that it invites the controversial is-ought inference, much contested in the philosophical literature. This problem is triggered when there are competing normative accounts (the arbitration problem), as empirical evidence can help arbitrate between descriptive theories, but not between normative systems. Drawing on linguistics as a model, we propose that clear distinction between normative systems and competence theories is essential, arguing that equating them invites an ‘is-ought’ inference; to wit, supporting normative ‘ought’ theories with empirical ‘is’ evidence. We analyze in detail two research programs with normativist features, Oaksford and Chater’s rational analysis, and Stanovich and West’s individual differences approach, demonstrating how in each case equating norm and competence leads to an is-ought inference. Normativism triggers a host of research biases in psychology of reasoning and decision making:focusing on untrained participants and novel problems, analyzing psychological processes in terms of their normative correlates, and neglecting philosophically significant paradigms when they do not supply clear standards for normative judgment. For example, in a dual-process framework, normativism can lead to a fallacious ‘ought-is’ inference, in which normative responses are taken as diagnostic of analytic reasoning. We propose that little can be gained from normativism that cannot be achieved by descriptivist computational-level analysis, illustrating our position with Hypothetical Thinking Theory and the theory of the suppositional conditional. We conclude that descriptivism is a viable option, and that theories of higher mental processing would be better off freed from normative considerations.

Your title, "LessWrong usually assumes normativism about rationality; Elqayam & Evans (2011) argue against it" makes it sound like the authors disagree with LW. I don't think they do. They're pointing out some methodological problems with psychological research that involves measuring people's actual cognitive processes against norms of rationality, which have little to do with our use of normativism (i.e., using normative rationality to improve people's reasoning and decision making).

In the conclusion they specifically disclaim that they're arguing against our kind of normativism:

It is not our purpose to exclude normativism entirely from scientific endeavor. There is a need for research in education, planning, policy development and so on, in all of which norms play a crucial role. The Meliorist position is a strong case in point, both the version advocated so powerfully by the individual differences research program of Stanovich and West (2000; Stanovich, 1999; 2004; 2009b), and the version put forward by Baron (e.g., 2008). Such authors wish to find ways improve people’s reasoning and decision-making and therefore require some standard definition of what it means to be rational.

I think they are also not saying that human thinking and decisions can't be measured against normative models. My understanding is that they are suggesting that doing so makes it easy for several fallacies and biases to sneak into one's research, so it's a bad idea in practice for someone trying to find out how humans actually think.

Critique accepted, post title and body edited.

10Paul Crowley15y

From this description, they are cautioning against treating the is-brain as the should-brain plus a diff.