You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

Velorien comments on Harry Potter and the Methods of Rationality discussion thread, July 2014, chapter 102 - Less Wrong Discussion

7 Post author: David_Gerard 26 July 2014 11:26AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (370)

You are viewing a single comment's thread. Show more comments above.

Comment author: Sophronius 01 August 2014 04:01:12PM *  1 point [-]

Hm, I didn't think I was reacting that strongly... If I was, it's probably because I am frustrated in general by people's inability to just take a step back and look at an issue for what it actually is, instead of superimposing their own favourite views on top of reality. I remember I recently got frustrated by some of the most rational people I know claiming that sun burn was caused by literal heat from the sun instead of UV light. Once they formed the hypothesis, they could only look at the issue through the 'eyes' of that view. And I see the same mistake made on Less Wrong all the time. I guess it's just frustrating to see EY do the same thing. I don't get why everyone, even practising rationalists, find this most elementary skill so hard to master.

Comment author: Velorien 01 August 2014 04:07:52PM 2 points [-]

Could you describe this skill in more detail please? If it is one I do not possess, I would like to learn.

Comment author: Sophronius 01 August 2014 04:35:36PM *  2 points [-]

Your attitude makes me happy, thank you. :)

It's the most basic rationalist skill there is, in my opinion, but for some reason it's not much talked about here. I call it "thinking like the universe" as opposed to "thinking like a human". It means you remove yourself from the picture, you forget all about your favourite views and you stop caring about the implications of your answer since those should not impact the truth of the matter, and describe the situation in purely factual terms. You don't follow any specific chain of logic towards finding an answer: You instead allow the answer to naturally flow from the facts.

It means you don't ask "which facts argue in favour of my view and which against?", but "what are the facts?"
It means you don't ask "What is my hypothesis?", you ask "which hypotheses flow naturally from the facts?"
It means you don't ask "What do I believe?" but "what would an intelligent person believe given these facts?"
It means you don't ask "which hypothesis do I believe is true?", but "how does the probability mass naturally divide itself over competing hypotheses based on the evidence?"
It means you don't ask "How can I test this hypothesis?" but "Which test would maximally distinguish between competing hypotheses?"
It means you never ever ask who has the "burden of proof".

And so on and so forth. I see it as the most fundamental skill because it allows you to ask the right questions, and if you start with the wrong question it really doesn't matter what you do with it afterwards.

Comment author: Velorien 01 August 2014 04:57:32PM 1 point [-]

I think I understand now, thank you.

Do you follow any specific practices in order to internalise this approach, or do you simply endeavour to apply it whenever you remember?

Comment author: Sophronius 01 August 2014 05:27:26PM *  3 points [-]

The primary thing I seem to do is to remind myself to care about the right things. I am irrelevant. My emotions are irrelevant. Truth is not influenced by what I want to be true. I am frequently amazed by the degree with which my emotions are influenced by subconscious beliefs. For example I notice that the people who make me most angry when they're irrational are the ones I respect the most. People who get offended usually believe at some level that they are entitled to being offended. People who are bad at getting to the truth of a matter usually care more about how they feel than about what is actually true. (This is related to the fundamental optimization problem: The truth will always sound less truthful than the most truthful sounding falsehood.) Noticing that kind of thing is often more effective than trying to control emotions the hard way.

Secondly, you want to pay attention to your thoughts as much as possible. This is just meditation, really. If you become conscious of your thoughts, you gain a degree of control over them. Notice what you think, when you think it, and why. If a question makes you angry, don't just suppress the anger, ask yourself why.

For the rest it's just about cultivating a habit of asking the right questions. Never ask yourself what you think, since the universe doesn't care what you think. Instead say "Velorien believes X: How much does this increase the probability of X?".

Bertrand Russel gets it right, of course

Comment author: Velorien 01 August 2014 05:52:30PM 1 point [-]

The truth will always sound less truthful than the most truthful sounding falsehood.

This needs to be on posters and T-shirts if it isn't already. Is it a well-known principle?

Thank you for the explanation. This overall idea (of the relationship between belief and reality, and the fact that it only goes one way) is in itself not new to me, but your perspective on it is, and I hope it will help me develop my ability to think objectively.

Also thanks for the music video. Shame I can't upvote you multiple times.

Comment author: Sophronius 01 August 2014 06:17:42PM *  2 points [-]

This needs to be on posters and T-shirts if it isn't already. Is it a well-known principle?

Sadly not. I keep meaning to post an article about this, but it's really hard to write an article about a complex subject in such a way that people really get it (especially if the reader has little patience/charity), so I keep putting it off until I have the time to make it perfect. I have some time this weekend though, so maybe...

I think the Fundamental Optimization Problem is the biggest problem humanity has right now and it explains everything that's wrong with society: It represents the fact that doing what's good will always feel less good than doing what feels good, people who optimize for altruism will always be seen as more selfish than people who optimize for being seen as altruistic, the people who get in power will always be the ones whose skills are optimized for getting in power and not for knowing what to do once they get there, and people who yell about truth the most are the biggest liars. It's also why "no good deed goes unpunished". Despite what Yoda claims, the dark side really is stronger.

Unfortunately there's no good post about this on LW AFAIK, but Yvain's post about Moloch is related and is really good (and really long).

Also thanks for the music video. Shame I can't upvote you multiple times.

Aww shucks. ^_^