Kaj_Sotala comments on Making Rationality General-Interest - LessWrong

30 Post author: Swimmer963 24 July 2013 10:02PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (117)

You are viewing a single comment's thread. Show more comments above.

Comment author: Kaj_Sotala 25 July 2013 09:02:02AM 9 points [-]

How about habits and norms like:

  • Consider it high status to change one's mind when presented with strong evidence against their old position
  • Offer people bets on beliefs that are verifiable and which they hold very strongly
  • When asked a question, state the facts that led you to your conclusion, not the conclusion itself
  • Encourage people to present the strongest cases they can against their own ideas
  • Be upfront about when you don't remember the source of your claim

(more)

It feels like it would be possible to get ordinary people to adopt at least some of these, and that their adoption would actually increase the general level of rationality.

Comment author: Qiaochu_Yuan 25 July 2013 07:07:58PM *  3 points [-]

I'm skeptical that these kinds of habits and norms can actually be successfully installed in ordinary people. I think they would get distorted for various reasons:

  • The hard part of using the first habit is figuring out what constitutes strong evidence. You can always rationalize to yourself that some piece of evidence is actually weak if you don't feel, on a gut level, like knowing the truth is more important than winning arguments.

  • There are several hard parts of using the second habit, like not getting addicted to gambling. Also, when people with inaccurate beliefs are consistently getting swindled by people with accurate beliefs, you're training the former to stop accepting bets, not to update their beliefs. This might still be useful for weeding out bad pundits, but then the pundit community doesn't actually have an incentive to adopt this habit.

  • The hard part of using the third habit is remembering what facts led you to your conclusion. Also, you can always cherrypick.

And so forth. These are all barriers I expect people with high IQ to deal with better than people with average IQ.

Comment author: Kaj_Sotala 26 July 2013 06:36:16AM 1 point [-]

You're probably right, but even distorted versions of the habits could be more useful than not having any at all, especially if the high-IQ people were more likely to actually follow their "correct" versions. Of course, there's the possibility of some of the distorted versions being bad enough to make the habits into net negatives.