I liked Duncan Sabien's Basics of Rationalist Discourse, but it felt somewhat different from what my brain thinks of as "the basics of rationalist discourse". So I decided to write down my own version (which overlaps some with Duncan's).
Probably this new version also won't match "the basics" as other people perceive them. People may not even agree that these are all good ideas! Partly I'm posting these just out of curiosity about what the delta is between my perspective on rationalist discourse and y'alls perspectives.
The basics of rationalist discourse, as I understand them:
1. Truth-Seeking. Try to contribute to a social environment that encourages belief accuracy and good epistemic processes. Try not to “win” arguments using symmetric weapons (tools that work similarly well whether you're right or wrong). Indeed, try not to treat arguments like soldiers at all.
2. Non-Violence: Argument gets counter-argument. Argument does not get bullet. Argument does not get doxxing, death threats, or coercion.[1]
3. Non-Deception. Never try to steer your conversation partners (or onlookers) toward having falser models. Where possible, avoid saying stuff that you expect to lower the net belief accuracy of the average reader; or failing that, at least flag that you're worried about this happening.
As a corollary:
3.1. Meta-Honesty. Make it easy for others to tell how honest, literal, PR-y, etc. you are (in general, or in particular contexts). This can include everything from "prominently publicly discussing the sorts of situations in which you'd lie" to "tweaking your image/persona/tone/etc. to make it likelier that people will have the right priors about your honesty".
4. Localizability. Give people a social affordance to decouple / evaluate the local validity of claims. Decoupling is not required, and indeed context is often important and extremely worth talking about! But it should almost always be OK to locally address a specific point or subpoint, without necessarily weighing in on the larger context or suggesting you’ll engage further.
5. Alternative-Minding. Consider alternative hypotheses, and ask yourself what Bayesian evidence you have that you're not in those alternative worlds. This mostly involves asking what models retrodict.
Cultivate the skills of original seeing and of seeing from new vantage points.
As a special case, try to understand and evaluate the alternative hypotheses that other people are advocating. Paraphrase stuff back to people to see if you understood, and see if they think you pass their Ideological Turing Test on the relevant ideas.
Be a fair bit more willing to consider nonstandard beliefs, frames/lenses, and methodologies, compared to (e.g.) the average academic. Keep in mind that inferential gaps can be large, most life-experience is hard to transmit in a small number of words (or in words at all), and converging on the truth can require a long process of cultivating the right mental motions, doing exercises, gathering and interpreting new data, etc.
Make it a habit to explicitly distinguish "what this person literally said" from "what I think this person means". Make it a habit to explicitly distinguish "what I think this person means" from "what I infer about this person as a result".
6. Reality-Minding. Keep your eye on the ball, hug the query, and don’t lose sight of object-level reality.
Make it a habit to flag when you notice ways to test an assertion. Make it a habit to actually test claims, when the value-of-information is high enough.
Reward scholarship, inquiry, betting, pre-registered predictions, and sticking your neck out, especially where this is time-consuming, effortful, or socially risky.
7. Reducibility. Err on the side of using simple, concrete, literal, and precise language. Make it a habit to taboo your words, do reductionism, explain what you mean, define your terms, etc.
As a corollary, applying precision and naturalism your own cognition:
7.1. Probabilism. Try to quantify your uncertainty to some degree.
8. Purpose-Minding. Try not to lose purpose (unless you're deliberately creating a sandbox for a more free-form and undirected stream of consciousness, based on some meta-purpose or impulse or hunch you want to follow).
Ask yourself why you're having a conversation, and whether you want to do something differently. Ask others what their goals are. Keep the Void in view.
As a corollary:
8.1. Cruxiness. Insofar as you have a sense of what the topic/goal of the conversation is, focus on cruxes, or (if your goal shifts) consider explicitly flagging that you're tangenting or switching to a new conversational topic/goal.[2]
9. Goodwill. Reward others' good epistemic conduct (e.g., updating) more than most people naturally do. Err on the side of carrots over sticks, forgiveness over punishment, and civility over incivility, unless someone has explicitly set aside a weirder or more rough-and-tumble space.[3]
10. Experience-Owning. Err on the side of explicitly owning your experiences, mental states, beliefs, and impressions. Flag your inferences as inferences, and beware the Mind Projection Fallacy and Typical Mind Fallacy.
As a corollary:
10.1. Valence-Owning. Err on the side of explicitly owning your shoulds and desires. Err on the side of stating your wants and beliefs (and why you want or believe them) instead of (or in addition to) saying what you think people ought to do.
Try to phrase things in ways that make space for disagreement, and try to avoid socially pressuring people into doing things. Instead, as a strong default, approach people with an attitude of informing and empowering them to do what they want.
Favor language with fewer and milder connotations, and make your arguments explicitly where possible, rather than relying excessively on the connotations, feel, fnords, or vibes of your words.
A longer, less jargony version of this post is available on the EA Forum.
- ^
Counter-arguments aren't the only OK response to an argument. You can choose not to reply. You can even ban someone because they keep making off-topic arguments, as long as you do this in a non-deceptive way. But some responses to arguments are explicitly off the table.
- ^
Note that "the topic/goal of the conversation" is an abstraction. "Goals" don't exist in a vacuum. You have goals (though these may not be perfectly stable, coherent, etc.), and other individuals have goals too. Conversations can be mutually beneficial when some of my goals are the same as some of yours, or when we have disjoint goals but some actions are useful for my goals as well as yours.
Be wary of abstractions and unargued premises in this very list! Try to taboo these prescriptions and claims, paraphrase them back, figure out why I might be saying all this stuff, and explicitly ask yourself whether these norms serve your goals too.
Part of why I've phrased this list as a bunch of noun phrases ("purpose-minding", etc.) rather than verb phrases ("mind your purpose", etc.) is that I suspect conversations will go better (on the dimension of goodwill and cheer) if people make a habit of saying "hm, I think you violated the principle of experience-owning there" or "hm, your comment isn't doing the experience-owning thing as much as I'd have liked", as opposed to "own your experience!!".
But another part of why I used nouns is that commands aren't experience-owning, and can make it harder for people to mind their purposes. I do have imperatives in the post (mostly because the prose flowed better that way), but I want to encourage people to engage with the ideas and consider whether they make sense, rather than just blindly obey them. So I want people to come into this post engaging with these first as ideas to consider, rather than as commands to obey.
- ^
Note that this doesn't require assuming everyone you talk to is honest or has good intentions.
It does have some overlap with the rule of thumb "as a very strong but defeasible default, carry on object-level discourse as if you were role-playing being on the same side as the people who disagree with you".
I like this example! I do indeed share the intuition "mocking Time Cube guy on Twitter doesn't reflect well on me as a rationalist". It also just seems mean to me.
I think part of what's driving my intuition here, though, is that "mocking" sounds inherently mean-spirited, and "on Twitter" makes it sound like I'm writing the sort of low-quality viral personal attack that's common on Twitter.
"Make a light-hearted reference to Time Cube (in a way that takes for granted that Time Cube is silly) in a chat with some friends" feels pretty unlike "write a tweet mocking and deriding Time Cube", and the former doesn't feel to me like it necessarily reflects poorly on me as a rationalist. (It feels more orthogonal to the spirit of rationality to me, like making puns or playing a video game; puns are neither rationalist nor anti-rationalist.)
So part of my reservation here is that I have pretty different intuitions about different versions of "tell jokes that turn on a certain claim/belief being low-probability", and I'm not sure where to draw the line exactly (beyond the general heuristics I mentioned in the OP).
Another part of my reservation is just that I'm erring on the side of keeping the list of norms too short rather than too long. I'd rather have non-exhaustive lists and encourage people to use their common sense and personal conscience as a guide in the many cases that the guidelines don't cover (or don't cover until you do some interpretive work).
I worry that modern society is too norm-heavy in general, encouraging people to fixate on heuristics, patches, and local Prohibited Actions, in ways that are cognitively taxing and unduly 'domesticating'. I think this can make it harder to notice and appropriately respond to the specifics of the situation you're in, because your brain is yelling a memorized "no! unconditional rule X!" script at you, when in fact if you consulted your unassisted conscience and your common sense you'd have an easier time seeing what the right thing to do is.
So I'm mostly interested in trying to distill core aspects of the spirit of rationalist discourse, in the hope that this can help people's common sense and conscience grow (/ help people become more self-aware of aspects of their common sense and conscience that are already inside themselves, but that they aren't lucid about).
I suspect I've left at least one important part of "the spirit of rationalist discourse" out, so I'm mainly nitpicking your suggestions in case your replies cause me to realize that I'm missing some important underlying generator that isn't alluded to in the OP. I care less about whether "mockery" specifically gets called out in the OP, and more about whether I've neglected an underlying spirit/generator.
Maybe Goodwill is missing a generator-sentence that's something like "Don't lean into cruelty, or otherwise lose sight of what your conscience or common sense says about how best to relate to other human beings."
Yeah, I like that more. I still worry that "low status" is vague and different people conceive of it differently, so I have the instinct that it might be good to taboo "status" here. "Conformance to norms" is also super vague; someone would need to have the right norms in mind in order for this to work.