While LessWrong contains a large amount of high-quality material, most of the rationality advice isn't actually targeted at our core audience. The focus seems to be more on irrational things that people do, rather than irrational things that smart people do. (Sidenote: If we wanted to create a site focused on spreading general rationality, then we'd need to simplify the discussion, remove a lot of the maths/controversial ideas and add in some friendly images. Does such a site exist?).

This has led to a number of comments questioning the real world value of having read the sequences. If your average person had the patience to read through the core sequences and understand them, they'd find them extremely valuable. It'd provide them with a glimpse into a new way of thinking and even though they would likely hardly appear to be very logical to most Less Wrongers, they'd be much better than they were at the start.

On the other hand, most Less Wrongers already know the basics of logic. That's not to say that we don't act extremely irrational much of the time, but just that going over the basics of logic again probably provides minimal benefit. What is needed is something specifically targeted at the kind of irrational mistakes and beliefs that intelligent people make. I would argue that if this were a sequence, it would be the most important sequence in the entire site. But, since I lack that level of writing ability, I'm not even going to attempt such a project. So I just created a post where we can list articles or ideas that should be part of such a sequence in the hope that someone else might pick it up

Here are some examples of mistakes that intelligent people make:

Taking a fixed instead of a growth mindset - shying away from challenges, convincing oneself that we are just naturally bad at non-intellectual things and that we shouldn't focus on them

Directly pointing out people's flaws

Overthinking issues that are really very simple

Counter-signalling by ignoring the value of fashion, money, being liked

Valuing intelligence above all other qualities

Rigidly adhering to rules

Expecting other people to always be rational

Not considering popularity as a signal that is worthwhile understanding

Overvaluing being right

I'm sure there are plenty more. Any other suggestions or relevant articles?

 

 

New to LessWrong?

New Comment
24 comments, sorted by Click to highlight new comments since: Today at 1:54 PM

I believe CFAR workshops address a lot of these issues, a huge focus of them being the interplay between high-level, logically thought out cognition (system 2) and the lower level, intuitive thinking (system 1). One of the major points was that system 1 is actually very useful at providing information and making decisions, so long as you ask the question right. Smart people I think tend to under-utilise system 1, often ignoring their gut feeling when it is providing useful information.

To use your fashion example, If I consider dressing up nicely, part of me says "This is all pointless, it's just signalling!", and wants me to squash the little voice that is telling me that actually, I value looking nice and should just give in to that desire because there are actual upsides and no downsides!

Again, I found that the CFARian way is to provisionally accept your terminal goals and gut feelings as legitimate, and go about satisfying them rather than criticising them too much (criticising them being a job for epistemic rationality, CFAR being more about instrumental rationality)

I'm hesitant to link you to Julia Galef's "The Straw Vulcan" talk, since everything you're writing seems so in line with it that I suspect you've already seen it! But if you haven't, it's incredibly relevant to this topic.

Another thing I'm reminded of is the post Reason as a Memetic Disorder. Basically, sometimes there are good cultural practises that smart people fail to see the logic behind (because it's subtle, or because it's inconsistent with some false belief they have), and so they drop the practise, to their detriment. Less smart people keep doing it, since they're happy to simply conform without having reasons for everything.

I suspect that the Sequences don't seem so useful to you for the reason that Scott Alexander pointed out in his recent five-year Less Wrong retrospective. Having read the Sequences, people find upon reading them that the concepts seem obvious, though they recall thinking they were revelatory at the time. There's something about learning an epistemological framework that makes it difficult to remember what it could have been like to think in any other terms. And yet, I did once argue about ways in which words were wrong, or fail to take into account the outside view, or waver between utilitarianism and deontology without even knowing those words. And I still suffer from scope insensitivity and the typical mind fallacy and a host of other issues.

The Sequences are for smart people. Rationality for not-as-smart people is: use contraception; quit smoking; astrology doesn't work; Cosmo's not a reliable source; don't get into credit card debt for trivial things; try to be more mindful about your hedonic or status treadmill.

Scope insensitivity, utilitarianism vs. deontology, ect. are all good things to know, but they wouldn't place in a list of the biggest mistakes smart people make

Outside of LesssWrong, the (Five Geek Social Fallacies)[http://www.plausiblydeniable.com/opinion/gsf.html] comes to mind.

That's less "smart people" and more "people who've grown up in a certain dysfunctional social environment", but there's a lot of overlap, yes. At least in the States.

Overthinking issues that are really very simple

Counter-signallign as a smart-person mistake

Valuing intelligence above all other qualities

Rigidly adhering to rules -- compare the two endings of "Three Worlds Collide" and the decision by which they diverge.

Expecting other people to always be rational

Got nothing for the last two. I don't think the last one is a mistake that very many people at all make. (I think being right about things has surprising benefits well past the point that most people can see it having benefits).

Other smart person mistake covering posts that spring to mind: http://lesswrong.com/lw/dxr/epiphany_addiction/ http://lesswrong.com/lw/j8/the_crackpot_offer/

And a lot of the general mistakes that LessWrong warns against are just person mistakes, rather than smart person or normal person mistakes. [edit: grammar]

Adding to this:

Directly pointing out people's flaws

I also don't see the problem with valuing being right highly. I can see the problem with letting people know that you are right too much.

Here are some examples of mistakes that intelligent people make

Looks like you mean "here are some examples of mistakes people on LessWrong still make."

Highly intelligent people such as great artists and writers, successful politicians and lawyers and drug kingpins, often depend on continued popularity, value social signaling extremely highly, know most people aren't rational, and don't rigidly follow rules.

However, I think it is interesting to consider whether there are qualities that are associated with intelligence, either biologically or through the way intelligent people are socialized, that are unintelligent in themselves. It seems like this is true with rationality; perhaps something about thinking rationally also causes people to, say, undervalue popularity to an irrational extent. I'm having a harder time thinking of examples that seem as likely with intelligence in general, although that's made trickier by having a vaguer definition of intelligence than rationality.

It seems like this is true with rationality; perhaps something about thinking rationally also causes people to, say, undervalue popularity to an irrational extent.

Rather than A causing B, I reckon it's more that A & B have a common cause, C: psychological traits that make someone more interested in thinking rationally tend to make them less interested in popularity.

I agree that LW isn't good at spreading general rationality to the general public, and I'm not even sure if that would be a good idea, since partial rationalists are great at pointing out errors in other people and coming across as arrogant jerks. However I don't agree that the errors that LW discusses don't happen to intelligent people. I have been guilty of all of the errors here.

Part of the sequence could be about finding our place in society. Links about that:

This gives a solid picture of the value of traditions and customs. In a way this is a social analog to the cognitive system 1. The analogy goeing as follows: System 2 - reason = well-defined formal structures; System 1 - intuition = vague or unjustified customs and traditions

System 1 is the intuitive one, system 2 is the formal reasoning.

The focus seems to be more on irrational things that people do, rather than irrational things that smart people do.

Help me understand better where you are coming from because I'd argue the opposite. Of the 9 articles or ideas that you want to see on LW, you listed 2 posts, Mestroyer and others listed 4 more, plus a few posts germane to the idea of smart people fail modes. intellectual hipsters and metacontrarianism is an all time top post.

Advice about akrasia, motivation, identity and happiness are for the benefit of people in general, and if anything most posts are tailored for smart people in mind. I might agree with you if I start seeing posts about wearing seat belts and use of contraception, but instead we have posts like the curse of identity and strategic choice of identity. Reflection on identity is epistemic rationality for smart people.

"Of the 9 articles or ideas that you want to see on LW, you listed 2 posts, Mestroyer and others listed 4 more, plus a few posts germane to the idea of smart people fail modes" - There are quite a few posts, but they are scattered over the whole site, rather than collected in a sequence or in a page.

Countersignalling is not necessarily a mistake, depending on how much the relevant people already know about you.

Fashion is a very interesting topic. I would like to have a CFAR zip hoodie that looks well to wear at event of the startup scene or when interacting with other programmers.

It could have the CFAR logo on the front and the CFAR mission statement at the back:

What if we could shrug off our feelings of defensiveness, and honestly evaluate the evidence on both sides of an issue before deciding which legislation to pass, what research to fund, and where to donate to do the most good?

Wear the right size, but you don't have to wake around with a Nike logo.

On the other hand, most Less Wrongers already know the basics of logic. That's not to say that we don't act extremely irrational much of the time, but just that going over the basics of logic again probably provides minimal benefit.

Logic is about the categories of true and false, Bayesianism is basically about the fact that 0 (false) and 1 (true) are not probabilities. It comes out of rejecting the "basics of logic" as Aristotle formulated them.

Going over the basics of reasoning is very useful because we aren't really clear about what they are. That's one of the core purposes of Lesswrong. It exists to explore how rationality actually works. Yes, frequently those discussions won't produce knowledge that's useful for daily life but if we can get more clear about how rationality works through discussing it in detail we can advance the field.

For Salsa Congresses there's the saying: The beginners go to the intermediate classes, the intermediates take the advanced classes and the advances folks take the beginner classes to brush up their basics.

In Zen there's the concept of the beginners mind, to constantly stay at the level where you think about basics.

Sidenote: If we wanted to create a site focused on spreading general rationality, then we'd need to simplify the discussion, remove a lot of the maths/controversial ideas and add in some friendly images. Does such a site exist?

You're describing RationalWiki.

RationalWiki is for spreading scientism and leftism, not rationality. But if the existence of RationalWiki is enough reason for people to refrain from making some new hoi polloi monstrosity, then by all means just point everyone to RationalWiki.