Intelligence-disadvantage

3 Post author: casebash 16 March 2014 07:14AM

While LessWrong contains a large amount of high-quality material, most of the rationality advice isn't actually targeted at our core audience. The focus seems to be more on irrational things that people do, rather than irrational things that smart people do. (Sidenote: If we wanted to create a site focused on spreading general rationality, then we'd need to simplify the discussion, remove a lot of the maths/controversial ideas and add in some friendly images. Does such a site exist?).

This has led to a number of comments questioning the real world value of having read the sequences. If your average person had the patience to read through the core sequences and understand them, they'd find them extremely valuable. It'd provide them with a glimpse into a new way of thinking and even though they would likely hardly appear to be very logical to most Less Wrongers, they'd be much better than they were at the start.

On the other hand, most Less Wrongers already know the basics of logic. That's not to say that we don't act extremely irrational much of the time, but just that going over the basics of logic again probably provides minimal benefit. What is needed is something specifically targeted at the kind of irrational mistakes and beliefs that intelligent people make. I would argue that if this were a sequence, it would be the most important sequence in the entire site. But, since I lack that level of writing ability, I'm not even going to attempt such a project. So I just created a post where we can list articles or ideas that should be part of such a sequence in the hope that someone else might pick it up

Here are some examples of mistakes that intelligent people make:

Taking a fixed instead of a growth mindset - shying away from challenges, convincing oneself that we are just naturally bad at non-intellectual things and that we shouldn't focus on them

Directly pointing out people's flaws

Overthinking issues that are really very simple

Counter-signalling by ignoring the value of fashion, money, being liked

Valuing intelligence above all other qualities

Rigidly adhering to rules

Expecting other people to always be rational

Not considering popularity as a signal that is worthwhile understanding

Overvaluing being right

I'm sure there are plenty more. Any other suggestions or relevant articles?

 

 

Comments (24)

Comment author: ChrisBillington 16 March 2014 07:48:17AM 11 points [-]

I believe CFAR workshops address a lot of these issues, a huge focus of them being the interplay between high-level, logically thought out cognition (system 2) and the lower level, intuitive thinking (system 1). One of the major points was that system 1 is actually very useful at providing information and making decisions, so long as you ask the question right. Smart people I think tend to under-utilise system 1, often ignoring their gut feeling when it is providing useful information.

To use your fashion example, If I consider dressing up nicely, part of me says "This is all pointless, it's just signalling!", and wants me to squash the little voice that is telling me that actually, I value looking nice and should just give in to that desire because there are actual upsides and no downsides!

Again, I found that the CFARian way is to provisionally accept your terminal goals and gut feelings as legitimate, and go about satisfying them rather than criticising them too much (criticising them being a job for epistemic rationality, CFAR being more about instrumental rationality)

I'm hesitant to link you to Julia Galef's "The Straw Vulcan" talk, since everything you're writing seems so in line with it that I suspect you've already seen it! But if you haven't, it's incredibly relevant to this topic.

Another thing I'm reminded of is the post Reason as a Memetic Disorder. Basically, sometimes there are good cultural practises that smart people fail to see the logic behind (because it's subtle, or because it's inconsistent with some false belief they have), and so they drop the practise, to their detriment. Less smart people keep doing it, since they're happy to simply conform without having reasons for everything.

Comment author: michaelkeenan 17 March 2014 04:20:43AM 8 points [-]

I suspect that the Sequences don't seem so useful to you for the reason that Scott Alexander pointed out in his recent five-year Less Wrong retrospective. Having read the Sequences, people find upon reading them that the concepts seem obvious, though they recall thinking they were revelatory at the time. There's something about learning an epistemological framework that makes it difficult to remember what it could have been like to think in any other terms. And yet, I did once argue about ways in which words were wrong, or fail to take into account the outside view, or waver between utilitarianism and deontology without even knowing those words. And I still suffer from scope insensitivity and the typical mind fallacy and a host of other issues.

The Sequences are for smart people. Rationality for not-as-smart people is: use contraception; quit smoking; astrology doesn't work; Cosmo's not a reliable source; don't get into credit card debt for trivial things; try to be more mindful about your hedonic or status treadmill.

Comment author: casebash 19 March 2014 04:20:50AM 0 points [-]

Scope insensitivity, utilitarianism vs. deontology, ect. are all good things to know, but they wouldn't place in a list of the biggest mistakes smart people make

Comment author: mare-of-night 16 March 2014 12:26:34PM 5 points [-]

Outside of LesssWrong, the (Five Geek Social Fallacies)[http://www.plausiblydeniable.com/opinion/gsf.html] comes to mind.

Comment author: Nornagest 16 March 2014 11:18:02PM 4 points [-]

That's less "smart people" and more "people who've grown up in a certain dysfunctional social environment", but there's a lot of overlap, yes. At least in the States.

Comment author: Mestroyer 16 March 2014 11:03:43AM *  4 points [-]

Overthinking issues that are really very simple

Counter-signallign as a smart-person mistake

Valuing intelligence above all other qualities

Rigidly adhering to rules -- compare the two endings of "Three Worlds Collide" and the decision by which they diverge.

Expecting other people to always be rational

Got nothing for the last two. I don't think the last one is a mistake that very many people at all make. (I think being right about things has surprising benefits well past the point that most people can see it having benefits).

Other smart person mistake covering posts that spring to mind: http://lesswrong.com/lw/dxr/epiphany_addiction/ http://lesswrong.com/lw/j8/the_crackpot_offer/

And a lot of the general mistakes that LessWrong warns against are just person mistakes, rather than smart person or normal person mistakes. [edit: grammar]

Comment author: pianoforte611 16 March 2014 03:24:57PM -1 points [-]

Adding to this:

Directly pointing out people's flaws

I also don't see the problem with valuing being right highly. I can see the problem with letting people know that you are right too much.

Comment author: seez 16 March 2014 09:28:37AM 3 points [-]

Here are some examples of mistakes that intelligent people make

Looks like you mean "here are some examples of mistakes people on LessWrong still make."

Highly intelligent people such as great artists and writers, successful politicians and lawyers and drug kingpins, often depend on continued popularity, value social signaling extremely highly, know most people aren't rational, and don't rigidly follow rules.

However, I think it is interesting to consider whether there are qualities that are associated with intelligence, either biologically or through the way intelligent people are socialized, that are unintelligent in themselves. It seems like this is true with rationality; perhaps something about thinking rationally also causes people to, say, undervalue popularity to an irrational extent. I'm having a harder time thinking of examples that seem as likely with intelligence in general, although that's made trickier by having a vaguer definition of intelligence than rationality.

Comment author: satt 17 March 2014 12:13:08AM 1 point [-]

It seems like this is true with rationality; perhaps something about thinking rationally also causes people to, say, undervalue popularity to an irrational extent.

Rather than A causing B, I reckon it's more that A & B have a common cause, C: psychological traits that make someone more interested in thinking rationally tend to make them less interested in popularity.

Comment author: pianoforte611 16 March 2014 03:19:54PM 1 point [-]

I agree that LW isn't good at spreading general rationality to the general public, and I'm not even sure if that would be a good idea, since partial rationalists are great at pointing out errors in other people and coming across as arrogant jerks. However I don't agree that the errors that LW discusses don't happen to intelligent people. I have been guilty of all of the errors here.

Comment author: niceguyanon 17 March 2014 04:22:23PM *  1 point [-]

The focus seems to be more on irrational things that people do, rather than irrational things that smart people do.

Help me understand better where you are coming from because I'd argue the opposite. Of the 9 articles or ideas that you want to see on LW, you listed 2 posts, Mestroyer and others listed 4 more, plus a few posts germane to the idea of smart people fail modes. intellectual hipsters and metacontrarianism is an all time top post.

Advice about akrasia, motivation, identity and happiness are for the benefit of people in general, and if anything most posts are tailored for smart people in mind. I might agree with you if I start seeing posts about wearing seat belts and use of contraception, but instead we have posts like the curse of identity and strategic choice of identity. Reflection on identity is epistemic rationality for smart people.

Comment author: casebash 19 March 2014 04:24:04AM 0 points [-]

"Of the 9 articles or ideas that you want to see on LW, you listed 2 posts, Mestroyer and others listed 4 more, plus a few posts germane to the idea of smart people fail modes" - There are quite a few posts, but they are scattered over the whole site, rather than collected in a sequence or in a page.

Comment author: [deleted] 16 March 2014 02:03:52PM 1 point [-]

Countersignalling is not necessarily a mistake, depending on how much the relevant people already know about you.

Comment author: Gunnar_Zarncke 16 March 2014 08:49:02AM *  1 point [-]

Part of the sequence could be about finding our place in society. Links about that:

This gives a solid picture of the value of traditions and customs. In a way this is a social analog to the cognitive system 1. The analogy goeing as follows: System 2 - reason = well-defined formal structures; System 1 - intuition = vague or unjustified customs and traditions

Comment author: Slackson 16 March 2014 09:38:03PM 2 points [-]

System 1 is the intuitive one, system 2 is the formal reasoning.

Comment author: Gunnar_Zarncke 16 March 2014 09:42:43PM 0 points [-]

fixed.

Comment author: ChristianKl 17 March 2014 05:11:54PM 0 points [-]

Fashion is a very interesting topic. I would like to have a CFAR zip hoodie that looks well to wear at event of the startup scene or when interacting with other programmers.

It could have the CFAR logo on the front and the CFAR mission statement at the back:

What if we could shrug off our feelings of defensiveness, and honestly evaluate the evidence on both sides of an issue before deciding which legislation to pass, what research to fund, and where to donate to do the most good?

Wear the right size, but you don't have to wake around with a Nike logo.