In Brief: Making yourself happy is not best achieved by having true beliefs, primarily because the contribution of true beliefs to material comfort is a public good that you can free ride on, but the signaling benefits and happiness benefits of convenient falsehoods pay back locally, i.e. you personally benefit from your adoption of convenient falsehoods. The consequence is that many people hold beliefs about important subjects in order to feel a certain way or be accepted by a certain group. Widespread irrationality is ultimately an incentive problem.
Note: this article has been edited to take into account Tom McCabe, Vladimir_M and Morendil's comments1
In asking why the overall level of epistemic rationality in the world is low and what we can do to change that, it is useful to think about the incentives that many people face concerning the effects that their beliefs have on their quality of life, i.e. on how it is that beliefs make people win.
People have various real and perceived needs; of which our material/practical needs and our emotional needs are two very important subsets. Material/practical needs include adequate nutrition, warmth and shelter, clothing, freedom from crime or attack by hostiles, sex and healthcare. Our emotional needs include status, friendship, family, love, a feeling of belonging and perhaps something called "self actualization".
Data strongly suggests that when material and practical needs are not satisfied, people live extremely miserable lives (this can be seen in the happiness/income correlation—note that very low incomes predict very low happiness). The comfortable life that we lead in developed countries seems to mostly protect us from the lowest depths of anguish, and I would postulate that a reasonable explanation is that almost all of us never starve, die of cold or get killed in violence.
The comfort that we experience (in the developed world) due to our modern technology is very much a product of the analytic-rational paradigm. That is to say a tradition of rational, analytic thinking stretching back through Watson & Crick, Bardeen, Einstein, Darwin, Adam Smith, Newton, Bacon, etc, is a crucial (necessary, and "nearly" sufficient) reason for our comfort.
However, that comfort is given roughly equally to everyone and is certainly not given preferentially to the kind of person who most contributed causally to it happening, including scientists, engineers and great thinkers (mostly because the people who make crucial contributions are usually dead by the time the bulk of the benefits arrive). To put it another way, irrationalists free-ride on the real-world material-comfort achievements of rationalists.
This means that once you find yourself in a more economically developed country, your individual decisions in improving the quality of your own life will (mostly) not involve thinking in the rational vein that caused you to be at the quite high quality you are already at. I have been reading a good self-help book which laments that studies have shown that 50% of one's happiness in life is genetically determined—highlighting the transhumanist case for re-engineering humanity for our own benefit—but that does not mean that to individually be more happy you should become an advocate for transhumanist paradise engineering, because such a project is a public good. It would be like trying to get to work faster by single-handedly building a subway.
The rational paradigm works well for societies, but not obviously for individuals
Instead, to ask what incentives apply to people's choice of beliefs and overall paradigm is to ask what beliefs will best facilitate the fulfillment of those needs to which individual incentives apply. Since our material/practical needs are relatively easily fulfilled (at least amongst non-dirt-poor people in the west), we turn our attention to emotional needs such as:
love and belonging, friendship, family, intimacy, group membership, esteem, status and respect from others, sense of self-respect, confidence
The beliefs that most contribute to these things generally deviate from factual accuracy, because factually accurate beliefs are picked out as being "special" or optimal by the planning model of winning, but love, esteem and belonging are typically not achieved by coming up with a plan to get them (coming up with a plan to make someone like you is often called manipulative and is widely criticized). In fact, love and belonging are typically much better fostered by shared nonanalytic or false beliefs, for example a common belief in God or something like religion (e.g. New Age stuff), in a political party or left/right/traditional/liberal alignment, and/or by personality variables, which are themselves influenced by beliefs in a way that doesn't go via the planning model.
The bottom line is that many people's "map" is not really like an ordinary map, in that its design criterion is not simply to reflect the territory; it is designed to make them fit into a group (religion, politics), feel good about themselves (belief in immortal soul and life after death), fit into a particular cultural niche or signal personality (e.g. belief in Chakras/Auras). Because of the way that incentives are set up, this may in many cases be individually utility maximizing, i.e. instrumentally rational. This seems to fit with the data—80% of the world are theists, including a majority of people in the USA, and as we have complained many times on this site, the overall level of rationality across many different topics (quality of political debate, uptake of cryonics, lack of attention paid to "big picture" issues such as the singularity, dreadful inefficiency of charity) is low.
Bryan Caplan has an economic theory to formalize this: he calls it rational irrationality. Thanks to Vladimir_M for pointing out that Caplan had already formalized this idea:
If the most pleasant belief for an individual differs from the belief dictated by rational expectations, agents weigh the hedonic benefits of deviating from rational expectations against the expected costs of self-delusion.
Beliefs respond to relative price changes just like any other good. On some level, adherents remain aware of what price they have to pay for their beliefs. Under normal circumstances, the belief that death in holy war carries large rewards is harmless, so people readily accept the doctrine. But in extremis, as the tide of battle turns against them, the price of retaining this improbable belief suddenly becomes enormous. Widespread apostacy is the result as long as the price stays high; believers flee the battlefield in disregard of the incentive structure they recently affirmed. But when the danger passes, the members of the routed army can and barring a shift in preferences will return to their original belief. They face no temptation to convert to a new religion or flirt with atheism.
1: The article was originally written with a large emphasis on Maslow's Hierarchy of needs, but it seems that this may be a "truthy" idea that propagates despite failures to confirm it experimentally.
I come into contact (of some sort) on nearly a daily basis with folks who lack one or several of the above: of these I do mean miserable at one of these levels. Not just the homeless, but a growing number of people struggling to make ends meet.
What I'm getting at is that your generalization that "once you find yourself in a more economically developed country, your individual decisions in improving the quality of your own life will (mostly) aim to climb from level two of Maslow upwards" requires some strong qualifications.
As a case in point consider a friend of mine who hasn't been paid by her employer for a few months, who has been enjoined by the court to keep showing up for work because failing to do so would be cause for termination of any benefits, and who therefore has to keep spending large amounts on oil to drive to work because in her employment-poor rural region most jobs are found at least one hour's drive away. This is someone I met over ten years ago, who was then comfortably middle class.
This person's situation isn't unusual or atypical, but it seems to me that it fits very poorly into your scheme whereby you describe her as a "free rider".
Conversely, quite a few people who benefit from the most visible trappings of the analytic-rational paradigm, by which I mean schools and universities, go on to occupy position in society which contribute little to the pool of knowledge, to the well-being of the majority, or in general to anything but their own narrow interest. Surely these folks, who presumably have the capacity to be rational, though they don't exploit it on an everyday basis, also deserve the "free rider" label?
Yet another category your black-and-white scheme seems to ignore is people who are typically asked to sacrifice their lives in defense of the institutions without which the efforts of "scientists, engineers and great thinkers" would have no discernible impact. Among these, I would bet that "irrationalists" are disproportionately represented.
You are, I think, considerably underestimating the difficulty of describing "our modern technology" in terms that would allow identification of "the kind of person who most contributed causally to it happening". The causal pathways are insanely long, intricately interwoven with the rest of the fabric of society, such that it is far from clear that the notion of "free riders" can apply at all.
Shorter: your post conveys an oversimplified conception of both science and society. (This is a common failing around these parts, possibly needing more posts like the one on the mangle, but this is a topic where the inferential distances appear to be substantial.)
Do you honestly think that this friend lives a worse life than a medieval peasant? Yes, people end up in financial trouble, but even in the USA they don't starve.
Your point about soldiers is taken, but note that in the west, very few soldiers die. The casualty count for Iraq is a few hundred for the UK, out of an army of 100,000. Those are much better odds than a paleolithic or bronze age soldie. Would have faced.