I agree that identifying yourself with the label rationality in such a manner that it interferes with acutal clear thinking is a grievous failure mode that people should be warned against. But it still seems useful to have some sort of terminology to talk about clear thinking, and I can't think of a better candidate term than rationality. I must say that I can't help but find it odd that you link to "Keep Your Identity Small" in discussing this problem. Did you read the footnotes? Graham lists that which we would call rationality as one of the few things you should keep in your identity:
[2] There may be some things it's a net win to include in your identity. For example, being a scientist. But arguably that is more of a placeholder than an actual label—like putting NMI on a form that asks for your middle initial—because it doesn't commit you to believing anything in particular. A scientist isn't committed to believing in natural selection in the same way a bibilical literalist is committed to rejecting it. All he's committed to is following the evidence wherever it leads.
Considering yourself a scientist is equivalent to putting a sign in a cupboard saying "this cupboard must be kept empty." Yes, strictly speaking, you're putting something in the cupboard, but not in the ordinary sense.
Graham says scientist where I would say aspiring rationalist, but it's essentially the same idea: believe true things, and use this true knowledge to do the best things, whatever they may be. Eliezer's "Twelve Virtues" contain the same warning as yours and Graham's:
How can you improve your conception of rationality? Not by saying to yourself, “It is my duty to be rational.” By this you only enshrine your mistaken conception. Perhaps your conception of rationality is that it is rational to believe the words of the Great Teacher, and the Great Teacher says, “The sky is green,” and you look up at the sky and see blue. If you think: “It may look like the sky is blue, but rationality is to believe the words of the Great Teacher,” you lose a chance to discover your mistake.
Do not ask whether it is “the Way” to do this or that. Ask whether the sky is blue or green. If you speak overmuch of the Way you will not attain it.
You may try to name the highest principle with names such as “the map that reflects the territory” or “experience of success and failure” or “Bayesian decision theory”. But perhaps you describe incorrectly the nameless virtue. How will you discover your mistake? Not by comparing your description to itself, but by comparing it to that which you did not name.
I do find it useful to self-identify as an aspiring rationalist, rather than simply as a rationalist, to disclaim any implications of having achieved some grand end state of rationality. I know that I'm still wrong---just hopefully less so than previously.
I agree that identifying yourself with the label rationality … But it still seems useful to have some sort of terminology to talk about clear thinking, and I can't think of a better candidate term than rationality.
‘Rationality’ is a perfectly fine term to talk about clear thinking, but that is quite a different matter to using 'rationalist' or any other term as a label to identify with.
...I must say that I can't help but find it odd that you link to "Keep Your Identity Small" in discussing this problem. Did you read the footnotes? Graham lis
I've noticed that here on Less Wrong people often identify themselves as rationalists (and this community as a rationalist one -- searching for 'rationalist' on the site returns exactly 1000 hits). I'm a bit concerned that this label may work against our favour.
Paul Graham recently wrote a nice essay Keep Your Identity Small in which he argued that identifying yourself with a label tends to work against reasonable -- rational, you might say -- disscusions about topics that are related to it. The essay is quite short and if you haven't read it I highly reccommend doing so.
If his argument is correct, then identifying with a label like Rationalist may impede your ability to be rational.
My thinking is that once you identify yourself as an X, you have a tendancy to evaluate ideas and courses of action in terms of how similar or different they appear to your prototypical notion of that label - as a shortcut for genuinely thinking about them and instead of evaluating them on their own merits.
Aside from the effect such a label may have on our own thinking, the term 'rationalist' may be bad PR. In the wider world 'rational' tends to be a bit of a dirty word. It has a lot of negative connotations.
Outside communities like this one, presenting yourself a rationalist is likely to get other people off on the wrong foot. In many people's minds, it'd strike you out before you'd even said anything. It's a great way for them to pigeonhole you.
And we should be interested in embracing the wider world and communicating our views to others.
If I was to describe what we're about, I'd probably say something like that we're interested in knowing the truth, and want to avoid deluding ourselves about anything, as much as either of these things are possible. So we're studying how to be less wrong. I'm not sure I'd use any particular label in my description.
Interestingly, those goals I described us in terms of -- wanting truth, wanting to avoid deluding ourselves -- are not really what separates "us" from "them". I think the actual difference is that we are simply more aware of the fact that there are many ways our thinking can be wrong and lead us astray.
Many people really are -- or at least start out -- interested in the truth, but get led astray by flawed thinking because they're not aware that it is flawed. Because flawed thinking begets flawed beliefs, the process can lead people onto systematic paths away from truth seeking. But I don't think even those people set out in the first place to get away from the truth.
The knowledge our community has, of ways that thinking can lead us astray, is an important thing we have to offer, and something that we should try to communicate to others. And I actually think a lot of people would be receptive to it, presented in the right way.