CronoDAS comments on The Lifespan Dilemma - Less Wrong

39 Post author: Eliezer_Yudkowsky 10 September 2009 06:45PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (214)

You are viewing a single comment's thread. Show more comments above.

Comment author: CronoDAS 10 September 2009 10:53:33PM *  2 points [-]

That doesn't quite work when comparing infinite sets. It might seem surprising, but indeed, there are exactly as many rational numbers between zero and one as there are between zero and two.

The short version of the explanation:

Two infinite sets are the same size if you can construct a one-to-one correspondence between them. In other words, if you can come up with a list of pairs (x,y) of members of sets X and Y such that every member of set X corresponds to exactly one member of set Y, and vice versa, then sets X and Y are the same size. For example, the set of positive integers and the set of positive even integers are the same size, because you can list them like this:

(1,2),

(2,4),

(3,6),

(4,8),

and so on. Each positive integer appears exactly once on the left side of the list, and each positive even integer appears exactly once on the right side of the list. You can use the same function I used here, f(x)=2x, to map the rational numbers between zero and one to the rational numbers between zero and two.

(As it turns out, you can map the positive integers to the rational numbers, but you can't map them to the real numbers...)

Comment author: Alicorn 10 September 2009 11:07:18PM *  3 points [-]

You are not the first person to try to explain this to me, but it doesn't seem "surprising", it seems like everybody is cooperating at pulling my leg. Since I'm aware that such a conspiracy would be impractical and that I am genuinely terrible at math, I don't think that's actually happening, but the fact remains that I just do not get this (and, at this point, no longer seriously entertain the hope of learning to do so). It is only slightly less obvious to me that there are more numbers between 0 and 2 than 0 and 1, than it is that one and one are two.

To put it a little differently, while I can understand the proofs that show how you may line up all the rationals in a sensible order and thereby assign an integer to each, it's not obvious to me that that is the way you should count them, given that I can easily think of other ways to count them where the integers will be used up first. Nothing seems to recommend the one strategy over the other except the consensus of people who don't seem to share my intuitions anyway.

Comment author: saturn 11 September 2009 08:30:52AM *  25 points [-]

Imagine A is the set of all positive integers and B is the set of all positive even integers. You would say B is smaller than A. Now multiply every number in A by two. Did you just make A become smaller without removing any elements from it?

Comment author: Alicorn 11 September 2009 12:32:04PM 8 points [-]

...Okay, that's weird! Clearly that shouldn't work. Thanks for the counterexample.

Comment author: DanielH 27 July 2013 04:32:36AM *  0 points [-]

It gets even worse than that if you want to keep your intuitions (which are actually partially formalized as the concept natural density). Imagine that T is the set of all Unicode text strings. Most of these strings, like "๐Ÿ‚พโจŸ๊ —โˆงฬŠโฉถ๐Ÿ", are gibberish, while some are valid sentences in various languages (such as "The five boxing wizards jump quickly.", "print 'Hello, world!'", "แผ”ฯƒฯ‡ฮฑฯ„ฮฟฯ‚ แผฯ‡ฮธฯแฝธฯ‚ ฮบฮฑฯ„ฮฑฯฮณฮตแฟ–ฯ„ฮฑฮน แฝ ฮธแฝฑฮฝฮฑฯ„ฮฟฯ‚ฮ‡", or "ื•ืงืจืืชื ื‘ืฉื ืืœื”ื™ื›ื ื•ืื ื™ ืืงืจื ื‘ืฉื ื™ื”ื•ื” ื•ื”ื™ื” ื”ืืœื”ื™ื ืืฉืจ ื™ืขื ื” ื‘ืืฉ ื”ื•ื ื”ืืœื”ื™ื ื•ื™ืขืŸ ื›ืœ ื”ืขื ื•ื™ืืžืจื• ื˜ื•ื‘ ื”ื“ื‘ืจ"). The interesting strings for this problem are things like "42", "22/7", "e", "10โ†‘โ†‘(10โ†‘โ†‘10)", or even "The square root of 17". These are the strings that unambiguously describe some number (under certain conventions). As we haven't put a length limit on the elements of T, we can easily show that every natural number, every rational number, and an infinite number of irrational numbers are each described by elements of T. As some elements of T don't unambiguously describe some number, our intuitions tell us that there are more text files than there are rational numbers.

However, a computer (with arbitrarily high disk space) would represent these strings encoded as sequences of bytes. If we use a BOM in our encoding, or if we use the Modified UTF-8 used in Java's DataInput interface, then every sequence of bytes encoding a string in T corresponds to a different natural number. However, given any common encoding, not every byte sequence corresponds to a string, and therefore not every natural number corresponds to a string. As encoding strings like this is the most natural way to map strings to natural numbers, there must intuitively be more natural numbers than strings.

We have thus shown that there are more strings than rational numbers, and more natural numbers than strings. Thus, any consistent definition of "bigger" that works like this can't be transitive, which would rule out many potential applications of such a concept.

EDIT: Fixed an error arising from my original thoughts differing from the way I wanted to explain them

Comment author: orthonormal 11 September 2009 12:05:51AM *  7 points [-]

I think that part of the difficulty (and part of the reason that certain people call themselves infinite set atheists) stems from the fact that we have two very basic intuitions about the quantity of finite sets, and it is impossible to define quantity for infinite sets in a way that maintains both intuitions.

Namely, you can have a notion of quantity for which

(A) sets that can be set in some 1-to-1 correspondence will have the same quantity,

OR a notion of quantity for which

(B) a set that strictly contains another set will have a strictly larger quantity.

As it turns out, given the importance of functions and correspondences in basic mathematical questions, the formulation (cardinality) that preserves (A) is very natural for doing math that extends and coheres with other finite intuitions, while only a few logicians seem to toy around with (B).

So it may help to realize that for mainstream mathematics and its applications, there is no way to rescue (B); you'll just need to get used to the idea that an infinite set and a proper subset can have the same cardinality, and the notion that what matters is the equivalence relation of there existing some 1-to-1 correspondence between sets.

Comment author: Cyan 11 September 2009 01:21:54AM *  1 point [-]

(B) is roughly measure theory, innit?

Comment author: Johnicholas 11 September 2009 01:29:38AM 0 points [-]

Yes, for some value of "roughly".

Comment author: Cyan 11 September 2009 01:41:59AM 0 points [-]

(A value of "roughly" that encompasses sets of measure zero is what I had in mind.)

Comment author: Alicorn 11 September 2009 12:14:02AM *  0 points [-]

My problem doesn't arise only when comparing sets such that one strictly contains another. I can "prove" to myself that there are more rational numbers between any two integers than there are natural numbers, because I can account for every last natural number with a rational between the two integers and have some rationals left over. I can also read other people "proving" that the rationals (between two integers or altogether, it hardly matters) are "countably infinite" and therefore not more numerous than the integers, because they can be lined up. I get that the second way of arranging them exists. It's just not at all clear why it's a better way of arranging things, or why the answer it generates about the relative sizes of the sets in question is a better answer.

Comment author: Johnicholas 11 September 2009 12:49:42AM 5 points [-]

If you come up with a different self-consistent definition of how to compare sizes of sets ("e.g. alicorn-bigger"), that would be fine. Both definitions can live happily together in the happy world of mathematics. Note that "self-consistent definition" is harder than it sounds.

There are cases where mainstream mathematical tradition was faced with competing definitions. Currently, the gamma function is the usual extension of the factorial function to the reals, but at one time, there were alternative definitions competing to be standardized.

http://www.luschny.de/math/factorial/hadamard/HadamardsGammaFunction.html

Another example: The calculus was motivated by thought experiments involving infinitesimals, but some "paradoxes" were discovered, and infinitistic reasoning was thought to be the culprit. By replacing all of the arguments with epsilon-delta analogs, the main stream of mathematics was able to derive the same results while avoiding infinitistic reasoning. Eventually, Abraham Robinson developed non-standard analysis, showing an alternative, and arguably more intuitive, way to avoid the paradoxes.

http://en.wikipedia.org/wiki/Non-standard_analysis

Comment author: Cyan 11 September 2009 01:45:19AM *  0 points [-]

Thanks for that super-interesting link about factorial-interpolating functions!

Comment author: orthonormal 11 September 2009 05:45:34PM 2 points [-]

The trouble is that with a little cleverness, you can account for all of the rationals by using some of the natural numbers (once each) and still have infinitely many natural numbers left over. (Left as an exercise to the reader.) That's why your intuitive notion isn't going to be self-consistent.

Comment author: CronoDAS 11 September 2009 09:51:55AM 4 points [-]

Well, that was the short explanation. The long one makes a little more sense. (By the way, the technical term for the number of members in a set is the cardinality of a set.)

Let's try this from a different angle.

If you have two sets, X and Y, and you can map X to a subset of Y and still have some members of Y left over, then X can't be a bigger set than Y is. In other words, a set can't "fit inside" a set that's smaller than itself. For example, {1,2,3} can fit inside {a,b,c,d}, because you can map 1 to a, 2 to b, 3 to c, and still have "d" left over. This means that {1,2,3} can't be bigger than {a,b,c,d}. It shouldn't matter how you do the mapping, because we only care about whether or not the whole thing fits. Am I making sense here?

Now, because you can map the positive even integers to a subset of the positive integers (for example, by mapping each positive integer to itself) and still have positive integers left over (all the odd ones), the set of positive even integers fits inside the set of positive integers, and so it can't be bigger than the set of positive integers.

On the other hand, the positive integers can also fit inside the positive even integers. Just map every positive integer n to the positive even integer 2*(n+1). You get the list (1,4), (2,6), (3,8), and so on. You've used up every positive integer, but you still have a positive even integer - 2 - left over. So, because the positive integers fit inside the positive even integers, so they're not bigger, either.

If the positive even integers aren't bigger than the positive integers, and the positive integers aren't bigger than the positive even integers, then the only way that could happen is if they are both exactly the same size. (Which, indeed, they are.)

Comment author: Alicorn 11 September 2009 12:30:33PM 2 points [-]

So in fact, we count them both ways, get both answers, and conclude that since each answer says that it is not the case that the one set is bigger than the other, they must be the same size?

Congratulations! I think I have, if not a perfect understanding of this, at least more of one than I had yesterday! Thanks :)

Comment author: CronoDAS 11 September 2009 06:34:54PM *  2 points [-]

You're welcome. I like to think that I'm good at explaining this kind of thing. ;) To give credit where credit is due, it was the long comment thread with DanArmak that helped me see what the source of your confusion was. And, indeed, all the ways of counting them matter. Mathematicians really, really hate it when you can do the same thing two different ways and get two different answers.

I learned about all this from a very interesting book I once read, which has a section on Georg Cantor, who was the one who thought up these ways of comparing the sizes of different infinite sets in the first place.

Comment author: cousin_it 10 September 2009 11:13:51PM *  1 point [-]

Sounds like you want measure instead of cardinality. Unfortunately, any subset of the rationals has measure 0, and I'm not pulling your leg either.

Comment author: Alicorn 10 September 2009 11:16:00PM 0 points [-]

I don't even understand the article on measure...

Comment author: cousin_it 10 September 2009 11:24:25PM *  1 point [-]

The main takeaway should be that counting, or one-to-one mapping, isn't a complete approach to comparing the "sizes" of infinite sets of numbers. For example, there are obviously as many prime numbers as there are naturals, because the number N may correspond to the Nth prime and vice versa; also see this Wikipedia article. For the same reason there are as many points between 0 and 1 as there are between 0 and 2, so to compare those two intervals we need something more than counting/cardinality. This "something more" is the concept of measure, which takes into account not only how many numbers a set contains, but also where and how they're laid out on the line. Unfortunately I don't know any non-mathematical shortcut to a rigorous understanding of measure; maybe others can help.

Comment author: Alicorn 10 September 2009 11:33:39PM 4 points [-]

For example, there are obviously as many prime numbers as there are naturals

You are guaranteed to lose me if you say things like this, especially if you put in "obviously". It's obvious to me (if false, in some freaky math way) that there are more natural numbers than prime numbers. The opposite of this statement is therefore not obvious to me.

Comment author: cousin_it 10 September 2009 11:44:46PM *  4 points [-]

The common-sense concept of "as many" or "as much" does not have a unique counterpart in mathematics: there are several formalizations for different purposes. In one widely used formalization (cardinality) there are as many primes as there are naturals, and this is indeed obvious for that formalization. If we take some other way of assigning sizes to number sets, like natural density, our two sets won't be equal any longer. And tomorrow you could invent some new formula that would give a third, completely different answer :-) It's ultimately pointless to argue which idea is "more intuitive"; the real test is what works in applications and what yields new interesting theorems.

Comment author: DanArmak 11 September 2009 12:16:55AM 2 points [-]

Cardinality compares two sets using one-to-one mappings. If such a mapping exists, the two sets are equal in cardinality.

In this sense, there are as many primes as there are natural numbers. Proof: arrange the primes as an infinite series of increasing numbers. Map each prime in the series to its index in the series, which is a natural number.

This definition is mathematically simple. On the other hand, the intuitive concept of "size" where the size of the real line segment [0,1] is smaller than that of [0,2] and there are fewer primes than naturals, is much more complex to define mathematically. It is handled by measure theory, but one of the intuitive problems with measure theory is that some subsets simply can't be measured.

If I understand correctly, there really are no actual infinities in the universe, at least not inside a finite volume (and therefore not in interaction due to speed of light limits). And as far as I can make out (someone please correct me if I'm wrong), there aren't infinitely many Everett branches arising from a quantum fork in the sense that we can't physically measure the difference between sufficiently similar outcomes, and there are finitely many measurement results we can see. So the mathematical handling of infinities shouldn't ever directly map to actual events in a non-intuitive sense.

Comment author: Alicorn 11 September 2009 12:21:53AM 0 points [-]

In this sense, there are as many primes as there are natural numbers. Proof: arrange the primes as an infinite series of increasing numbers. Map each prime in the series to its index in the series, which is a natural number.

Yes, I get that you can do that! I get that you can do that - I just don't know why you should do that, instead of doing it the way that seems like the sensible way to do it in my head. What recommends this arrangement over any other arrangement?

Comment author: komponisto 11 September 2009 03:17:16AM *  2 points [-]

What recommends this arrangement over any other arrangement?

Nothing at all, except that it shows there exists such a correspondence -- which is the only question of interest when talking about the "size" (cardinality) of sets.

(EDIT: Perhaps I should add that this question of existence is interesting because the situation can be quite different for different pairs of sets: while there exists a 1-1 correspondence between primes and natural numbers, there does not exist any such correspondence between primes and real numbers. In that case, all mappings will leave out some real numbers -- or duplicate some primes, if you're going the other way.)

All the other ways of "counting" that you're thinking of are just as "valid" as mathematical ideas, for whatever other purposes they may be used for. Here's an example, actually: the fact that you can think of a way of making primes correspond in a one-to-one fashion to a proper subset of the natural numbers (not including all natural numbers) succeeds in showing that the set of primes is no larger than the set of natural numbers.

Comment author: GuySrinivasan 11 September 2009 12:07:33AM 2 points [-]

It is obvious only if you've had the oddities of infinite sets hammered into you. Here's why our intuitions are wrong (the common ones I hear):

"Clearly there are more natural numbers than prime numbers. Prime numbers are a strict subset of natural numbers!" --> the strict subset thing works when everything is finite. But why? Because you can count out all the smaller set, then you have more left over in the larger set, so it's bigger. For infinite sets, though, you can't "count out all the smaller set" or equivalent.

"Okay, but if I choose an integer uniformly at random, there's a 50% chance it's a natural number and a < 50% chance it's a prime number. 50 > <50, so there are more natural numbers." --> You can't choose an integer uniformly at random.

"Really?" --> Yes, really. There are an infinite number of them, so with what probability is 42 selected? Not 0, 'cause then it won't be selected. Not >0, 'cause then the probabilities don't add to 1.

"Fine, if I start counting all the natural numbers and prime numbers (1: 1,0. 2: 2,1. 3: 3,2. 4: 4,2.) I'll find that the number of naturals is always greater than the number of primes." --> You've privileged an order, why? Instead let's start at 2, then 3, then 5, then 7, etc. Now they're equal.

"Something's still fishy." --> Yes, all of these are fine properties to think about. They happen to be equivalent for finite sets and not for infinite sets. We choose cousin_it's correspondence thing to be "size" for infinite sets, because it turns out to make the most sense. But the other properties could be interesting too.

Comment author: Alicorn 11 September 2009 12:17:54AM 1 point [-]

For infinite sets, though, you can't "count out all the smaller set" or equivalent.

Well, no, but there are finite sets I can't actually count either. I can, however, specify a way to translate an integer (or whatever) into something else, and as long as that algorithm can in principle be applied to any integer (or whatever), I consider myself to have in so doing accounted for all of them. For instance, when comparing the set of primes to the set of naturals, I say to myself, "okay, all of the primes will account for themselves. All of the naturals will account for themselves. There are naturals that don't account for primes, but no primes that don't account for naturals. Why, looks like there must be more naturals than primes!"

Comment author: DanArmak 11 September 2009 12:21:58AM 2 points [-]

This reasoning is intuitive (because it arises by extension from finite sets) but unfortunately leads to inconsistent results.

Consider two different mappings ('accountings') of the naturals. In the first, every integer stands for itself. In the second, every integer x maps to 2*x, so we get the even numbers. By your logic, you would be forced to conclude that the set of naturals is "bigger" than itself.

Comment author: Alicorn 11 September 2009 12:24:27AM 0 points [-]

Consider two different mappings ('accountings') of the naturals. In the first, every integer stands for itself. In the second, every integer x maps to 2*x, so we get the even numbers. By your logic, you would be forced to conclude that the set of naturals is "bigger" than itself.

But in that case something does recommend the first accounting over the second. The second one gives an answer that does not make sense, and the first one gives an answer that does make sense.

In the case of comparing rationals to integers, or any of the analogous comparisons, it's the accounting that People Good At Mathโ„ข supply that makes no sense (to me).