Less Wrong is a community blog devoted to refining the art of human rationality. Please visit our About page for more information.

MrHen comments on What is Bayesianism? - Less Wrong

81 Post author: Kaj_Sotala 26 February 2010 07:43AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (211)

You are viewing a single comment's thread. Show more comments above.

Comment author: MrHen 01 March 2010 06:51:36PM 5 points [-]


If you thought a cold was more likely, well, that was the answer I was after.

Part of the great danger in explaining a High topic is that people who haven't been able to understand High topics are super wary about looking like an idiot. Math is the most obvious High topic that people hate trying to understand. They would much rather admit to fearing math than trying and failing at understanding it.

This is sad, to me, because math isn't really that hard to understand. It is a daunting subject that never ends but the fundamentals are already understood by anyone who functions in society. They just never put all the pieces together with the right terms.

I am firmly convinced that the Way of Bayes is like this. The sequences are, for the most part, about subjects that could be easy to understand. They make intuitive sense. The details and the numbers are a pain, but the concept itself is something I could explain to nearly everyone I know. (So I think. I haven't actually tried yet.)

A sentence like the one I quoted above is one that will put a layperson on defensive. This pushes Bayesianism into the realm of High topics: Topics that are grasped by the Smart people; the intellectual elite. Asking them questions at all makes them realize they don't know the answer. This is scary. Immediately answering the question and telling them the answer should be obvious could easily make them feel awkward, even if they got the answer correct.

Articles explaining "obvious" things are often explaining not-obvious things and assume that you are following them each step of the way. These articles are full of trick questions and try to make you second guess yourself in an effort to show you what you do not know. This is scary and elitist to someone who has sold their own intelligence short.

Your example is so minor that most people wouldn't have a problem with it. I bring it up because I am picky. This is an example of aiming far, far too high. The audience at LessWrong reads a question/answer like this and enjoys it. They like learning they are wrong and revel in the introspection that follows as they chase down the error in the machine so they can fix it. A layperson dreads this. They think it means they are stupid and unable to understand. They fail at the competition of intelligence whether the competition actually exists or not.

Even if a brain tumor caused a headache every time, and a cold caused a headache only one per cent of the time (say), having a cold is so much more common that it's going to cause a lot more headaches than brain tumors do.

I think this belongs in the description of the example. You could even leave out the actual numbers because they only matter for the people that have the exact numbers. It takes too long to explain that you just made the numbers up because:

  • Every word is more processing that needs to be done
  • The intended audience are probably inexperienced at skimming these sorts of topics
  • The numbers really are irrelevant
  • Someone will disagree with the numbers and make a big stink about something that was irrelevant

Bayes' theorem, basically, says that if cause A might be the reason for symptom X, then we have to take into account both the probability that A caused X (found, roughly, by multiplying the frequency of A with the chance that A causes X) and the probability that anything else caused X. (For a thorough mathematical treatment of Bayes' theorem, see Eliezer's Intuitive Explanation.)

And... the layperson just zoned out. This is the big obstacle in trying to describe Bayesianism. Math scares people away. Even people who are good at math will glaze over when they see As and Xs and words like "probability." I have no idea how to get around this obstacle, honestly. Your attempt was solid. But I still think this is the paragraph where you will lose the lowest rung of your audience.

There should be nothing surprising about that, of course.

What if they were surprised? What if their whole world reeled at the question of what causes headaches? What if, horrifically, they completely misunderstood the previous example and are currently pondering if their headache means they have a brain tumor?

If they are completely bewildered right now, telling them they shouldn't be surprised will make them feel dumb. Even if they are dumb, your article shouldn't make them feel dumb. It should make them feel smart.

Suppose you're outside, and you see a person running. They might be running for the sake of exercise, or they might be running because they're in a hurry somewhere, or they might even be running because it's cold and they want to stay warm. To figure out which one is the case, you'll try to consider which of the explanations is true most often, and fits the circumstances best.

I don't think this example clarifies much. A bullet list:

  • "they're in a hurry somewhere" sounds funny to me. Perhaps, "they're in a hurry to get somewhere" or "they're in a hurry" works better? This could be a style thing.
  • Running because it's cold will mean random things to random people. If I am outside and its cold I don't think of running. I think of doing hard work like shoveling snow or simply going inside. The reason I bring this up is because every second someone thinks, "That's weird, why would you run outside if it's cold?" is a second that the points you made above get shoved further away from the points below.
  • To figure out which one is the case, people could think of (a) asking the runner (b) looking for more evidence. Judging which reason happens most often may not translate well. I didn't even attach this language to the headache on first read. If you know the answer you can see the relation but I am not confident that it is available for every reader.

More coming if you still want it. My lunch break is over. :)

Comment author: Kaj_Sotala 01 March 2010 08:41:57PM 0 points [-]

Very interesting. Actually, I didn't seek to aim that low - I was targeting the average LW reader (or at least an average person who was comfortable with maths). However, I still find this to be very valuable, since I have played around with the idea of trying to write a book that'd attempt to sell (implicitly or explicitly) the idea of "maths / science, especially as applied to rationality / cognitive science is actually fun" to a lay audience.

So I probably won't alter the original article as a reaction to this, but if you want to nevertheless help me in figuring out how to reach to that audience, do continue. :)

Comment author: MrHen 01 March 2010 09:20:00PM 0 points [-]

So I probably won't alter the original article as a reaction to this, but if you want to nevertheless help me in figuring out how to reach to that audience, do continue. :)

Haha, will do. I do realize that some of what I am bringing up is extremely petty, but I have watched some of my articles get completely derailed by what I would consider to be a completely irrelevant point. Even amongst the high quality discussions in the comments I find myself needing to back up and ask a Really Obvious Question.

This is likely a fault in the way I communicate (which is accentuated online) and also a glitch where people are not willing/able to drop subjects that are bugging them. If I was fundamentally opposed to the claim that all brain tumors caused headaches I would feel compelled to point it out in the comments. (This compulsion is something I am trying to curb.)

In any case, I am glad the comments are helpful and I will continue as I find the time. If you ever start drafting something like what you mentioned I am willing to proofread and comment.