= 27d567bc2d48d9f40e9ccc20ea370b15)
Eliezer_Yudkowsky comments on The two meanings of mathematical terms - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
= 783df68a0f980790206b9ea87794c5b6)
Loading…= b715d02e85f7b3b4ae65ca3d3e450868)
Subscribe to RSS Feed
Powered by Reddit
= f037147d6e6c911a85753b9abdedda8d)
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (78)
Right, but in this context I wouldn't label such "mathematical parts" as part of intuitionism per se. What I'm talking about here is a certain school of thought that holds that mainstream (infinitary, nonconstructive) mathematics is in some important sense erroneous. This is a belief that Eliezer has been hitherto unwilling to disclaim -- for no reason that I can fathom other than a sense of warm glow around E.T. Jaynes.
(Needless to say, Eliezer is welcome to set the record straight on this any time he wishes...)
I do not understand what the word "erroneous" is supposed to mean in this context.
For the sake of argument, I will go ahead and ask what sort of nonconstructive entities you think an AI needs to reason about, in order to function properly.
Some senses of "erroneous" that might be involved here include (this list is not necessarily intended to be exhaustive):
Mathematically incorrect -- i.e. the proofs contain actual logical inconsistencies. This was argued by some early skeptics (such as Kronecker) but is basically indefensible ever since the formulation of axiomatic set theory and results such as Gödel's on the consistency of the Axiom of Choice. Such a person would have to actually believe the ZF axioms are inconsistent, and I am aware of no plausible argument for this.
Making claims that are epistemologically indefensible, even if possibly true. E.g., maybe there does exist a well-ordering of the reals, but mere mortals are in no position to assert that such a thing exists. Again, axiomatic formalization should have meant the end of this as a plausible stance.
Irrelevant or uninteresing as an area of research because of a "lack of correspondence" with "reality" or "the physical world". In order to be consistent, a person subscribing to this view would have to repudiate the whole of pure mathematics as an enterprise. If, as is more common, the person is selectively criticizing certain parts of mathematics, then they are almost certainly suffering from map-territory confusion. Mathematics is not physics; the map is not the territory. It is not ordained or programmed into the universe that positive integers must refer specifically to numbers of elementary particles, or some such, any more than the symbolic conventions of your atlas are programmed into the Earth. Hence one cannot make a leap e.g. from the existence of a finite number of elementary particles to the theoretical adequacy of finitely many numbers. To do so would be to prematurely circumscribe the nature of mathematical models of the physical world. Any criticism of a particular area of mathematics as "unconnected to reality" necessarily has to be made from the standpoint of a particular model of reality. But part (perhaps a large part) of the point of doing pure mathematics (besides the fact that it's fun, of course), is to prepare for the necessity, encountered time and time again in the history of our species, of upgrading -- and thus changing --our very model. Not just the model itself but the ways in which mathematical ideas are used in the model. This has often happened in ways that (at least at the time) would have seemed very surprising.
Well, if the AI is doing mathematics, then it needs to reason about the very same entities that human mathematicians reason about.
Maybe that sounds like begging the question, because you could ask why humans themselves need to reason about those entities (which is kind of the whole point here). But in that case I'm not sure what you're getting at by switching from humans to AIs.
Do you perhaps mean to ask something like: "What kind of mathematical entities will be needed in order to formulate the most fundamental physical laws?"
Regarding your three bullet points above:
It's rude to start refuting an idea before you've finished defining it.
One of these things is not like the others. There's nothing wrong with giving us a history of constructive thinking, and providing us with reasons why outdated versions of the theory were found wanting. It's good style to use parallel construction to build rhetorical momentum. It is terribly dishonest to do both at the same time -- it creates the impression that the subjective reasons you give for dismissing point 3 have weight equal to the objective reasons history has given for dismissing points 1 and 2.
Your talk in point 3 about "map-territory confusion" is very strange. Mathematics is all in your head. It's all map, no territory. You seem to be claiming that constructivsts are outside of the mathematical mainstream because they want to bend theory in the direction of a preferred outcome. You then claim that this is outside of the bounds of acceptable mathematical thinking, So what's wrong with reasoning like this:
"Nobody really likes all of the consequences of the Axiom of Choice, but most people seem willing to put up with its bad behavior because some of the abstractions it enables -- like the Real Numbers -- are just so damn useful. I wonder how many of the useful properties of the Real Numbers I could capture by building up from (a possibly weakened version of) ZF set theory and a weakened version of the Axiom of Choice?"
I'm sorry, but I don't think there was anything remotely "rude" or "terribly dishonest" about my previous comment. If you think I am mistaken about anything I said, just explain why. Criticizing my rhetorical style and accusing me of violating social norms is not something I find helpful.
Quite frankly, I also find criticisms of the form "you sound more confident than you should be" rather annoying. E.g:
That's because for me, the reasons I gave in point 3 do indeed have similar weight to the reasons I gave in points 1 and 2. If you disagree, by all means say so. But to rise up in indignation over the very listing of my reasons -- is that really necessary? Would you seriously have preferred that I just list the bullet points without explaining what I thought?
Nothing at all, except for the false claim that nobody likes the consequences of the Axiom of Choice. (Some people do like them, and why shouldn't they?)
The target of my critique -- and I thought I made this clear in my response to cousin_it -- is the critique of mainstream mathematical reasoning, not the research program of exploring different axiomatic set theories. The latter could easily be done by someone fully on board with the soundness of traditional mathematics. Just as it is unnecessary to doubt the correctness of Euclid's arguments in order to be interested in non-Euclidean geometry.
Until very recently, I held a similar attitude. I think it's common to be annoyed by this sort of criticism... it's distracting and rarely relevant.
That said, it seems to me that the above "rarely" isn't rare enough. If you're inadvertently violating a social norm, wouldn't you like to know? If you already know, what does it matter to have it pointed out to you? Just ignore the redundant information.
I think this principle extends to a lot of speculative or subjective criticism. The potential value of just one accurate critique taken to heart seems quite high. Does such criticism have a positive expected value? That depends on the overall cost of the associated inaccurate or redundant statements (i.e., the vast majority of them). It seems this cost can be made to approach zero by just not taking them personally and ignoring them when they're misguided, so long as they're sufficiently disentangled from "object-level" statements.
Why do you think that the axiomatic formulation of ZFC "should have meant an end" to the stance that ZFC makes claims that are epistemologically indefensible? Just because I can formalize a statement does not make that statement true, even if it is consistent. Many people (including me and apparently Eliezer, though I would guess that my views are different from his) do not think that the axioms of ZFC are self-evident truths.
In general, I find the argument for Platonism/the validity of ZFC based on common acceptance to be problematic because I just don't think that most people think about these issues seriously. It is a consensus of convenience and inertia. Also, many mathematicians are not Platonists at all but rather formalists -- and constructivism is closer to formalism than Platonism is.
Aaaand this makes me curious. Eliezer, for the sake of argument, do you really think we'd do good by prohibiting the AI from using reductio ad absurdum?
Nope. I do believe in classical first-order logic, I'm just skeptical about infinite sets. I'd like to hear k's answer, though.
Perhaps this would make a good subject for my inaugural top-level post. I'll try to write one up in the near future.
Okay. I have several sources of skepticism about infinite sets. One has to do with my never having observed a large cardinal. One has to do with the inability of first-order logic to discriminate different sizes of infinite set (any countably infinite set of first-order statements that has an infinite model has a countably infinite model - i.e. a first-order theory of e.g. the real numbers has countable models as well as the canonical uncountable model) and that higher-order logic proves exactly what a many-sorted first-order logic proves, no more and no less. One has to do with the breakdown of many finite operations, such as size comparison, in a way that e.g. prevents me from comparing two "infinite" collections of observers to determine anthropic probabilities.
The chief argument against my skepticism has to do with the apparent physical existence of minimal closures and continuous quantities, two things that cannot be defined in first-order logic but that would, apparently, if you take higher-order logic at face value, suffice respectively to specify the existence of a unique infinite collection of natural numbers and a unique infinite collection of points on a line.
Another point against my skepticism is that first-order set theory proper and not just first-order Peano Arithmetic is useful to prove e.g. the totalness of the Goodstein function, but while a convenient proof uses infinite ordinals, it's not clear that you couldn't build an AI that got by just as well on computable functions without having to think about infinite sets.
My position can be summed up as follows: I suspect that an AI does not have to reason about large infinities, or possibly any infinities at all, in order to deal with reality.
I reject infinity as anything more than "a number that is big enough for its smallness to be negligible for the purpose at hand."
My reason for rejecting infinity in it's usual sense is very simple: it doesn't communicate anything. Here you said (about communication) "When you each understand what is in the other's mind, you are done." In order to communicate, there has to be something in your mind in the first place, but don't we all agree infinity can't ever be in your mind? If so, how can it be communicated?
Edit to clarify: I worded that poorly. What I mean to ask is, Don't we all agree that we cannot imagine infinity (other than imagine something like, say, a video that seems to never end, or a line that is way longer than you'd ever seem to need)? If you can imagine it, please just tell me how you do it!
Also, "reject" is too strong a word; I merely await a coherent definition of "infinity" that differs from mine.
Yes but it doesn't matter. The moon can't literally be in your mind either. Since your mind is in your brain, then if the moon were in your mind it would be in your brain, and I don't even know what would happen first: your brain would be crushed against your skull (which would in turn explode), and the weight of the moon would crush you flat (and also destroy whatever continent you were on and then very possibly the whole world).
But you can still think about the moon without it literally having to be in your mind.
Same with infinity.
I can visualize the moon. If I say the word "moon," and you get a picture of the moon in your mind - or some such thing - then I feel like we're on the same page. But I can't visualize "infinity," or when I do it turns out as above. If I say the word "infinity" and you visualize (or taste, or whatever) something similar, I feel like we've communicated, but then you would agree with my first line in the above post. Since you don't agree, when I say "infinity," you must get some very different representation in your mind. Does it do the concept any more justice that my representations? If so, please tell me how to experience it.
We refer to things with signs. The signs don't have to be visual representations. We can think about things by employing the signs which refer to them. What makes the sign for (say) countable infinity refer to it is the way that the sign is used in a mathematical theory (countable infinity being a mathematical concept). Learn the math, and you will learn the concept.
Compare to this: you probably cannot visualize the number 845,264,087,843,113. You can of course visualize the sign I just now wrote for it, but you cannot visualize the number itself (by, for example, visualizing a large bowl with exactly that number of pebbles in it). What you can do is visualize a bowl with a vast number of pebbles in it, while thinking the thought, "this imagined bowl has precisely 845,264,087,843,113 pebbles in it." Here you would be relying entirely on the sign to make your mental picture into a picture of exactly that number of pebbles. In fact you could dispense with the picture entirely and keep only the sign, and you would successfully be thinking about that number, purely by employing its sign in your thoughts. Note that you can do operations on that sign, such as subtracting another number by manipulating the two signs via the method you learned as a child. So you have mastered (some of) the relevant math, so the sign, as you employ it, really does refer to that number.
From your post it sounds like you in fact do not have a clear picture of infinity in your head. I have a feeling this is true for many people, so let me try to paint one. Throughout this post I'll be using "number" to mean "positive integer".
Suppose that there is a distinction we can draw between certain types of numbers and other types of numbers. For example, we could make a distinction between "primes" and "non-primes". A standard way to communicate the fact that we have drawn this distinction is to say that there is a "set of all primes". This language need not be construed as meaning that all primes together can be coherently thought of as forming a collection (though it often is construed that way, usually pretty carelessly); the key thing is just that the distinction between primes and non-primes is itself meaningful. In the case of primes, the fact that the distinction is meaningful follows from the fact that there is an algorithm to decide whether any given number is prime.
Now for "infinite": A set of numbers is called infinite if for every number N, there exists a number greater than N in the set. For example, Euclid proved that the set of primes is infinite under this definition.
Now this definition is a little restrictive in terms of mathematical practice, since we will often want to talk about sets that contain things other than numbers, but the basic idea is similar in the general case: the semantic function of a set is provided not by the fact that its members "form a collection" (whatever that might mean), but rather by the fact that there is a distinction of some kind (possibly of the kind that can be determined by an algorithm) between things that are in the set and things that are not in the set. In general a set is "infinite" if for every number N, the set contains more than N members (i.e. there are more than N things that satisfy the condition that the set encodes).
So that's "infinity", as used in standard mathematical practice. (Well, there's also a notion of "infinity" in real analysis which essentially is just a placeholder symbol for "a really large number", but when people talk about the philosophical issues behind infinity it is usually about the definition I just gave above, not the one in real analysis, which is not controversial.) Now, why is this at all controversial? Well, note that to define it, I had to talk about the notion of distinctions-in-general, as opposed to any individual distinction. But is it really coherent to talk about a notion of distinctions-in-general? Can it be made mathematically precise? This is really what the philosophical arguments are all about: what kinds of things are allowed to count as distinctions. The constructivists take the point of view that the only things that should be allowed to count as distinctions are those that can be computed by algorithms. There are some bullets to bite if you take this point of view though. For example, the twin prime conjecture states that for every number N, there exists p > N such that both p and p+2 are prime. Presumably this is either true or false, even if nobody can prove it. Moreover, presumably each number N either is or is not a counterexample to the conjecture. But then it would seem that it is possible to draw a distinction between those N which satisfy the conclusion of the conjecture, and those which are counterexamples. Yet this is false according to the constructive point of view, since there is no algorithm to determine whether any given N satisfies the conclusion of the conjecture.
I guess this is probably long enough already given that I'm replying to a five-year-old post... I could say more on this topic if people are interested.
I think you mean, 'determine that it does not satisfy the conclusion'.
I think my original sentence is correct; there is no known algorithm that provably outputs the answer to the question "Does N satisfy the conclusion of the conjecture?" given N as an input. To do this, an algorithm would need to do both of the following: output "Yes" if and only if N satisfies the conclusion, and output "No" if and only if N does not satisfy the conclusion. There are known algorithms that do the first but not the second (unless the twin prime conjecture happens to be true).
You're pointing to a concept represented in your brain, using a label which you expect will evoke analogous representations of that concept in readers' brains, and asserting that that thing is not something that a human brain could represent.
The various mathematical uses of infinity (infinite cardinals, infinity as a limit in calculus, infinities in nonstandard analysis, etc.) are all well-defined and can be stored as information-bearing concepts in human brains. I don't think there's any problem here.
It looks like we agree but you either misread or I was unclear:
I'm not asserting that the definition of infinity I mentioned at the beginning ("a number that is big enough for its smallness to be negligible for the purpose at hand") is not something a human brain could represent. I'm saying that if the speaker considers "infinity" to be something that a human brain cannot represent, I must question what they are even doing when they utter the word. Surely they are not communicating in the sense Eliezer referred to, of trying to get someone else to have the same content in their head. (If they simply want me to note a mathematical symbol, that is fine, too.)
I also agree that various uses of concepts that could be called infinity in math can be stored in human brains, but that depends on the definitions. I am not "anti-infinity" except if the speaker claims that their infinity cannot be represented in anyone's mind, but they are talking about it anyway. That would just be a kind of "bluffing," as it were. If there are sensical definitions of infinity that seem categorically different than the ones I mentioned so far, I'd like to see them.
In short, I just don't get infinity unless it means one of the things I've said so far. I don't want to be called a "finitist" if I don't even know what the person means by "infinite."
One has to do with the breakdown of many finite operations, such as size comparison, in a way that e.g. prevents me from comparing two "infinite" collections of observers to determine anthropic probabilities.
Born probabilities seem to fit your bill perfectly. :-)
Don't think I haven't noticed that. (In fact I believe I wrote about it.)