Thanks Kaj, this is my favourite article on LessWrong at the moment. I have plenty to learn.
Most valuable to me at the moment:
Before you stake your argument on a point, ask yourself in advance what you would say if that point were decisively refuted. If you wouldn't actually change your mind, search for a point that you find more convincing. (Is That Your True Rejection? at CATO Unbound)
In discussions, presume the kinds of conditions that are the least convenient for your argument. (The Least Convenient Possible World)
If people are trying to figure out the truth, don't mistake their opinions about facts for statements of values. (Levels of communication)
Only pass on ideas that you've verified yourself. (Problematic, since any given individual can only verify a tiny fraction of all of their beliefs.) (The ethic of hand-washing)
Explicitly separate “individual impressions” (impressions based only on evidence you've verified yourself) from “beliefs” (which include evidence from others’ impressions). (Naming beliefs)
Leave the other person a line of retreat in all directions, avoiding pressures that might wedge them towards either your ideas or their own. (The ethic of hand-washing) Encourage people to present the strongest cases they can against their own ideas. (comment, Carl Shulman)
The wiki entry for Epistemic Hygiene defines the term as:
Epistemic hygiene consists of practices meant to allow accurate beliefs to spread within a community and keep less accurate or biased beliefs contained. The practices are meant to serve an analogous purpose to normal hygiene and sanitation in containing disease.
The term was coined in Steve Rayhawk's and Anna Salamon's post "The ethic of hand-washing and community epistemic practice", and there have been several mentions of it around the site. But what, exactly, might good epistemic hygiene norms be?
I'm especially interested in this question in the context of meetup groups. In Less Wrong NYC: Case Study of a Successful Rationalist Chapter, Cosmos writes:
Epistemic privilege and meme-sharing: The most powerful aspect of a group of rationalists is that you have an entire class of people whose reasoning you trust. Division of labor arises naturally as each member has different interests, they all pursue a variety of skills and areas of expertise, which they can then bring back to the group. Even the lowest-level rationalists in the group can rapidly upgrade themselves by adopting winning heuristics from other group members. I cannot overstate the power of epistemic privilege. We have rapidly spread knowledge about metabolism, exercise, neuroscience, meditation, hypnosis, several systems of therapy... and don't forget the Dark Arts.
This would imply that one way that a meetup group (or for that matter, any social group) could get really successful would be by adopting great epistemic hygiene norms. But unless everyone present has read most of the Sequences - which gets increasingly unlikely the more the group grows - even most LW meetups probably won't just spontaneously enforce such norms. Wouldn't it be great if there were an existing list of such norms, that each group could look through and then decide which ones they'd like to adopt?
Here are some possible epistemic hygiene norms that I could find / come up with:
And of course, there's a long list of norms that basically amount to "don't be guilty of bias X", e.g. "avoid unnecessarily detailed stories about the future", "avoid fake explanations", "don't treat arguments as soldiers", etc.
Which of these norms do you consider the most valuable? Which seem questionable? Do you have any norms of your own to propose?