I have so far distinguished between belief as anticipation-controller, belief in belief, professing and cheering. Of these, we might call anticipation-controlling beliefs "proper beliefs" and the other forms "improper belief". Proper belief can be wrong or irrational, as when someone genuinely anticipates that prayer will cure their sick baby. But the other forms are arguably “not belief at all.”
Yet another form of improper belief is belief as group identification—as a way of belonging. Robin Hanson uses the excellent metaphor of wearing unusual clothing, a group uniform like a priest’s vestments or a Jewish skullcap, and so I will call this “belief as attire.”
In terms of humanly realistic psychology, the Muslims who flew planes into the World Trade Center undoubtedly saw themselves as heroes defending truth, justice, and the Islamic Way from hideous alien monsters a la the movie Independence Day. Only a very inexperienced nerd, the sort of nerd who has no idea how non-nerds see the world, would say this out loud in an Alabama bar. It is not an American thing to say. The American thing to say is that the terrorists “hate our freedom” and that flying a plane into a building is a “cowardly act.” You cannot say the phrases “heroic self-sacrifice” and “suicide bomber” in the same sentence, even for the sake of accurately describing how the Enemy sees the world. The very concept of the courage and altruism of a suicide bomber is Enemy attire—you can tell, because the Enemy talks about it. The cowardice and sociopathy of a suicide bomber is American attire. There are no quote marks you can use to talk about how the Enemy sees the world; it would be like dressing up as a Nazi for Halloween.
Belief-as-attire may help explain how people can be passionate about improper beliefs. Mere belief in belief, or religious professing, would have some trouble creating genuine, deep, powerful emotional effects. Or so I suspect; I confess I’m not an expert here. But my impression is this: People who’ve stopped anticipating-as-if their religion is true, will go to great lengths to convince themselves they are passionate, and this desperation can be mistaken for passion. But it’s not the same fire they had as a child.
On the other hand, it is very easy for a human being to genuinely, passionately, gut-level belong to a group, to cheer for their favorite sports team.1 Identifying with a tribe is a very strong emotional force. People will die for it. And once you get people to identify with a tribe, the beliefs which are the attire of that tribe will be spoken with the full passion of belonging to that tribe.
1 This is the foundation on which rests the swindle of “Republicans vs. Democrats” and analogous false dilemmas in other countries, but that’s a topic for another time.
I think questioning the Alabama bar analogy is useful within the context of this post. Whose attire is a belief in the value of giving primacy skepticism, critical thinking, etc.? According to Eliezer's performance in the OP, it's not the attire of either Alabama bar patrons or "muslim terrorist suicide bombers" -and both of those may signal more generally, the losers of the American Civil War and non-white brown people. In short, I think there may be a gentrification of critical thinking: it's reserved for an in-group, perhaps in particular northeastern anglo-saxon and ashkenazi jewish male intellectuals, or an even more narrow archetypal definition that might be reducible to zero actual people. I'm interested in the degree to which our behavior might be governed by aligning with and contesting these archetypes. Including which beliefs as attire to wear (it's perhaps an archetype alignment for Steven Hawkings and Richard Dawkins to claim to be skeptical about religion. It would probably not be an archetype alignment for Oprah to publicly wear such belief attire, even if in fact she was a crypto-skeptic).
This post may meander a bit but I think Eliezer's post (and some of the criticisms of it) are thought provoking and may be getting us closer to a more real world, real time model of how bias and belief is operating in the world we live in.
I know if I were in an Alabama bar, and the conversation turned to how "terrorists hate our freedoms", I'd certainly phrase things such that they didn't contradict what everyone in the room was yelling about.
Bonus points if I were clever enough to disagree with them in a way that seemed like I was agreeing with them.
Either way, I'd be wearing a belief I most certainly did not actually believe and did not in any way believe I believed, and I would do so entirely for my own preservation.