komponisto comments on The Importance of Self-Doubt - Less Wrong

23 Post author: multifoliaterose 19 August 2010 10:47PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (726)

You are viewing a single comment's thread. Show more comments above.

Comment author: komponisto 24 August 2010 10:53:27PM *  3 points [-]

If the machine prints out 50 1's, and then someone runs in and smashes it beyond repair, before it has a chance to continue, will you walk away, saying, "There is a chance at most of 1 in 60,000 that Islam is true?"

If so, are you serious?

Of course I'm serious (and I hardly need to point out the inadequacy of the argument from the incredulous stare). If I'm not going to take my model of the world seriously, then it wasn't actually my model to begin with.

Sewing-Machine's comment below basically reflects my view, except for the doubts about numbers as a representation of beliefs. What this ultimately comes down to is that you are using a model of the universe according to which the beliefs of Muslims are entangled with reality to a vastly greater degree than on my model. Modulo the obvious issues about setting up an experiment like the one you describe in a universe that works the way I think it does, I really don't have a problem waiting for 66 or more 1's before converting to Islam. Honest. If I did, it would mean I had a different understanding of the causal structure of the universe than I do.

Further below you say this, which I find revealing:

If this actually happened to you, and you walked away and did not convert, would you have some fear of being condemned to hell for seeing this and not converting? Even a little bit of fear? If you would, then your probability that Islam is true must be much higher than 10^-20, since we're not afraid of things that have a one in a hundred billion chance of happening.

As it happens, given my own particular personality, I'd probably be terrified. The voice in my head would be screaming. In fact, at that point I might even be tempted to conclude that expected utilities favor conversion, given the particular nature of Islam.

But from an epistemic point of view, this doesn't actually change anything. As I argued in Advancing Certainty, there is such a thing as epistemically shutting up and multiplying. Bayes' Theorem says the updated probability is one in a hundred billion, my emotions notwithstanding. This is precisely the kind of thing we have to learn to do in order to escape the low-Earth orbit of our primitive evolved epistemology -- our entire project here, mind you -- which, unlike you (it appears), I actually believe is possible.

Comment author: Wei_Dai 25 August 2010 12:59:57AM 4 points [-]

Has anyone done a "shut up and multiply" for Islam (or Christianity)? I would be interested in seeing such a calculation. (I did a Google search and couldn't find anything directly relevant.) Here's my own attempt, which doesn't get very far.

Let H = "Islam is true" and E = everything we've observed about the universe so far. According to Bayes:

P(H | E) = P(E | H) P(H) / P(E)

Unfortunately I have no idea how to compute the terms above. Nor do I know how to argue that P(H|E) is as small as 10^-20 without explicitly calculating the terms. One argument might be that P(H) is very small because of the high complexity of Islam, but since E includes "23% of humanity believe in some form of Islam", the term for the complexity of Islam seems to be present in both the numerator and denominator and therefore cancel each other out.

If someone has done such a calculation/argument before, please post a link?

Comment author: FAWS 25 August 2010 04:00:32PM 3 points [-]

the term for the complexity of Islam seems to be present in both the numerator and denominator and therefore cancel each other out.

Actually it doesn't, human generated complexity is different from naturally generated complexity (for instance it fits into narratives, apparent holes are filled with the sort of justifications a human is likely to think of etc.). That's one of the ways you can tell stories from real events. Religious accounts contain much of what looks like human generated complexity.

Comment author: [deleted] 25 August 2010 03:49:31PM 2 points [-]
  1. Here's a somewhat rough way of estimating probabilities of unlikely events. Let's say that an event X with P(X) = about 1-in-10 is a "lucky break." Suppose that there are L(1) ways that Y could occur on account of a single lucky break, L(2) ways that Y could occur on account of a pair of independent lucky breaks, L(3) ways that Y could occur on account of 3 independent lucky breaks, and so on. Then P(Y) is approximately the sum over all n of L(n)/10^n. I have the feeling that arguments about whether P(Y) is small versus extremely small are arguments about the growth rate of L(n).

  2. I discussed the problem of estimating P("23% of humanity believes...") here. I'd be grateful for thoughts or criticisms.

Comment author: cousin_it 25 August 2010 01:03:20PM *  3 points [-]

P(E) includes the convincingness of Islam to people on average, not the complexity of Islam. These things are very different because of the conjunction fallacy. So P(H) can be a lot smaller than P(E).

Comment author: Wei_Dai 25 August 2010 10:26:06PM 3 points [-]

I don't understand how P(E) does not include a term for the complexity of Islam, given that E contains Islam, and E is not so large that it takes a huge number of bits to locate Islam inside E.

Comment author: Furcas 25 August 2010 11:37:01PM 1 point [-]

I don't think that's true; cousin_it had it right the first time. The complexity of Islam is the complexity of a reality that contains an omnipotent creator, his angels, Paradise, Hell, and so forth. Everything we've observed about the universe includes people believing in Islam, but not the beings and places that Islam says exist.

In other words, E contains Islam the religion, not Islam the reality.

Comment author: PaulAlmond 25 August 2010 11:42:16PM 2 points [-]

The really big problem with such a reality is that it contains a fundamental, non-contingent mind (God's/Allah's, etc) - and we all know how much describing one of those takes - and the requirement that God is non-contingent means we can't use any simpler, underlying ideas like Darwinian evolution. Non-contingency, in theory selection terms, is a god killer: It forces God to incur a huge information penalty - unless the theist refuses even to play by these rules and thinks God is above all that - in which case they aren't even playing the theory selection game.

Comment author: Perplexed 26 August 2010 12:44:41AM 2 points [-]

I don't see this. Why assume that the non-contingent, pre-existing God is particularly complex. Why not assume that the current complexity of God (if He actually is complex) developed over time as the universe evolved since the big bang. Or, just as good, assume that God became complex before He created this universe.

It is not as if we know enough about God to actually start writing down that presumptive long bit string. And, after all, we don't ask the big bang to explain the coastline of Great Britain.

Comment author: PaulAlmond 26 August 2010 12:58:08AM 1 point [-]

If we do that, should we even call that "less complex earlier version of God" God? Would it deserve the title?

Comment author: Perplexed 26 August 2010 01:06:20AM 1 point [-]

Sure, why not? I refer to the earlier, less complex version of Michael Jackson as "Michael Jackson".

Comment author: Furcas 25 August 2010 11:49:49PM 1 point [-]

Non-contingency, in theory selection terms, is a god killer

Agreed. It's why I'm so annoyed when even smart atheists say that God was an ok hypothesis before evolution was discovered. God was always one of the worst possible hypotheses!

unless the theist refuses even to play by these rules and thinks God is above all that - in which case they aren't even playing the theory selection game.

Or, put more directly: Unless the theist is deluding himself. :)

Comment author: cousin_it 27 August 2010 09:58:18AM *  1 point [-]

I'm confused. In the comments to my post you draw a distinction between an "event" and a "huge set of events", saying that complexity only applies to the former but not the latter. But Islam is also a "huge set of events" - it doesn't predict just one possible future, but a wide class of them (possibly even including our actual world, ask any Muslim!), so you can't make an argument against it based on complexity of description alone. Does this mean you tripped on the exact same mine I was trying to defuse with my post?

I'd be very interested in hearing a valid argument about the "right" prior we should assign to Islam being true - how "wide" the set of world-programs corresponding to it actually is - because I tried to solve this problem and failed.

Comment author: byrnema 26 August 2010 12:20:24AM 0 points [-]

The problem is that reality itself is apparently fundamentally non-contingent. Adding "mind" to all that doesn't seem so unreasonable.

Comment author: PaulAlmond 26 August 2010 12:30:43AM 0 points [-]

Do you mean it doesn't seem so unreasonable to you, or to other people?

Comment author: byrnema 26 August 2010 01:04:24AM *  0 points [-]

By reasonable, I mean the hypothesis is worth considering, if there were reasons to entertain it. That is, if someone suspected there was a mind behind reality, I don't think they should dismiss it out of hand as unreasonable because this mind must be non-contingent.

In fact, we should expect any explanation of our creation to be non-contingent, since physical reality appears to be so.

For example, if it's reasonable to consider the probability that we're in a simulation, then we're considering a non-contingent mind creating the simulation we're in.

Comment author: Vladimir_Nesov 26 August 2010 09:51:29AM 0 points [-]

It doesn't take a lot of bits to locate "Islam is false" based on "Islam is true". Does it mean that all complex statements have about 50% probability?

Comment author: cousin_it 26 August 2010 01:26:18PM 0 points [-]

I just wrote a post about that.

Comment author: cousin_it 25 August 2010 10:47:19PM *  -1 points [-]

Whoops, you're right. Now I'm ashamed that my comment got upvoted.

I think the argument may still be made to work by fleshing out the nonstandard notion of "complexity" that I had in my head when writing it :-) Your prior for a given text being true shouldn't depend only on the text's K-complexity. For example, the text "A and B and C and D" has the same complexity as "A or B or C or D", but the former is way less probable. So P(E) and P(H) may have the same term for complexity, but P(H) also gets a "conjunction penalty" that P(E) doesn't get because people are prey to the conjunction fallacy.

EDIT: this was yet another mistake. Such an argument cannot work because P(E) is obviously much smaller than P(H), because E is a huge mountain of evidence and H is just a little text. When trying to reach the correct answer, we cannot afford to ignore P(E|H).

Comment author: Vladimir_Nesov 26 August 2010 09:44:28AM *  1 point [-]

For simplicity we may assume P(E|H) to be near-certainty: if there is an attention-seeking god, we'd know about it. This leaves P(E) and P(H), and P(H|E) is tiny exactly for the reason you named: P(H) is much smaller than P(E), because H is optimized for meme-spreading to a great extent, which makes for a given complexity (that translates into P(H)) probability of gaining popularity P(E) comparatively much higher.

Thus, just arguing from complexity indeed misses the point, and the real reason for improbability of cultish claims is that they are highly optimized to be cultish claims.

For example, compare with tossing a coin 50 times: the actual observation, whatever that is, will be a highly improbable event, and theoretical prediction from the model of fair coin will be too. But if the observation is highly optimized to attract attention, for example it's all 50 tails, then theoretical model crumbles, and not because the event you've observed is too improbable according to it, but because other hypotheses win out.

Comment author: gjm 17 June 2015 01:39:01PM 0 points [-]

There are some very crude sketches of shutting-up-and-multiplying, from one Christian and a couple of atheists, here (read the comments as well as the post itself), and I think there may be more with a similar flavour in other blog posts there (and their comments) from around the same time.

(The author of the blog has posted a little on LW. The two skeptics responsible for most of the comments on that post have both been quite active here. One of them still is, and is in fact posting this comment right now :-).)

Comment author: Unknowns 25 August 2010 07:06:33AM 0 points [-]

Wei Dai, exactly. The point about about the complexity of the thing is included in the fact that people believe it was the point I have been making all along. Regardless of what you think the resulting probability is, most of the "evidence" for Islam consists in the very fact that some people think it is true-- and as you show in your calculation, this is very strong evidence.

It seems to me that komponisto and others are taking it to be known with 100% certainly that Islam and the like were generated by some random process, and then trying to determine what the probability would be.

Now I know that most likely Mohammed was insane and in effect the Koran was in fact generated by a random process. But I certainly don't know how you can say that the probability that it wasn't generated randomly is 1 in 10^20 or lower. And in fact if you're going to assign a probability like this you should have an actual calculation.

Comment author: [deleted] 25 August 2010 01:37:42AM 0 points [-]

This is a small point but "E includes complex claim C" does not imply that the (for instance, Kolmogorov) complexity of E is as large as the Kolmogorov complexity of C. The complexity of the digits of square root of 2 is pretty small, but they contain strings of arbitrarily high complexity.

Comment author: Wei_Dai 25 August 2010 01:56:07AM 2 points [-]

E includes C implies that K(C) <= K(E) + K(information needed to locate C within E). In this case K(information needed to locate C within E) seems small enough not to matter to the overall argument, which is why I left it out. (Since you said "this is a small point" I guess you probably understand and agree with this.)

Comment author: [deleted] 25 August 2010 02:09:51AM 1 point [-]

Actually no I hadn't thought of that. But I wonder if the amount of information it takes to locate "lots of people are muslims" within E is as small as you say. My particular E does not even contain that much information about Islam, and how people came to believe it, but it does contain a model of how people come to believe weird things in general. Is that a misleading way of putting things? I can't tell.

Comment author: Unknowns 25 August 2010 07:13:27AM *  -2 points [-]

I agree that your position is analogous to "shutting up and multiplying." But in fact, Eliezer may have been wrong about that in general -- see the Lifespan Dilemma -- because people's utility functions are likely not unbounded.

In your case, I agree with shutting up and multiplying when we have a way to calculate the probabilities. In this case, we don't, so we can't do it. If you had a known probability (see cousin_it's comment on the possible trillions of variants of Islam) of one in a trillion, then I would agree with walking away after seeing 30 1's, regardless of the emotional effect of this.

But in reality, we have no such known probability. The result is that you are going to have to use some base rate: "things that people believe" or more accurately, "strange things that people believe" or whatever. In any case, whatever base rate you use, it will not have a probability anywhere near 10^-20 (i.e. more than 1 in 10^20 strange beliefs is true etc.)

My real point about the fear is that your brain doesn't work the way your probabilities do-- even if you say you are that certain, your brain isn't. And if we had calculated the probabilities, you would be justified in ignoring your brain. But in fact, since we haven't, your brain is more right than you are in this case. It is less certain precisely because you are simply not justified in being that certain.