Less Wrong is a community blog devoted to refining the art of human rationality. Please visit our About page for more information.

Learning the foundations of math

4 Post author: jsalvatier 24 October 2010 07:29PM

I have recently become interested in the foundations of math. I am interested in tracing the fundamentals of math in a path such as: propositional logic -> first order logic -> set theory -> measure theory. Does anyone have any resources (books, webpages, pdfs etc.) they would like to recommend?

This seems like it would be a popular activity among LWers, so I thought this would be a good place to ask for advice.

My criteria (feel free to post resources which you think others who stumble across this might be interested in):

  • The more basic the starting point the better: I would prefer a resource that defines propositional logic in terms of a context free grammar and an evaluation procedure (don't know if that is possible, but that's the sort of thing I am interested in) to one that just describes propositional logic in English; I would prefer a resource which builds first order logic from propositional logic + some definitions to one that just describes how first order logic works; etc.
  • The fewer axioms (perhaps that's not quite the right word) the better. I prefer a resource defines describes propositional logic with just two operators (say negation and conjugation) and then builds the other operators of interest to one that defines it with 5 or 6 operators (I've seen many resources which do this).
  • I expect that there are multiple ways to build math from basic building blocks. I am more interested in standard ways than than non-standard ways.

 

Comments (31)

Comment author: nhamann 25 October 2010 12:49:31AM *  1 point [-]

So it looks like you're interested in learning the fundamentals of classical logic and set theory, and then paving your way towards measure theory. If you don't have a solid background in set theory, then you probably don't have a strong background in real analysis either, which to my understanding is needed for measure theory. (I don't know how you can do measure theory without even knowing what the Riemann integral is).

You should take a look at Real mathematical analysis by Pugh. You're going to need to know basic stuff like basic set theory and functions and such as a prereq, but it's a very lucid introduction to real analysis with metric space topology and compactness and connectedness and all that. It was the first book I found that had a good explanation of Dedekind cuts (Rudin's Principles of Mathematical Analysis has a very terse description. Pugh, on the other hand, has pictures!)

For measure theory, I haven't read very far through them but here is a 4-volume set on Measure theory available for free online from D.H. Fremlin. It has some introductory set theory stuff if I recall, which might be a good starting point if your grasp on logic is strong enough.

For basic logic, How to Prove It: A Structured Approach by Velleman is my personal favorite.

Comment author: [deleted] 24 October 2010 09:06:31PM 2 points [-]

Cohn's Measure Theory is good for measure theory. Rudin's Real and Complex Analysis is more standard, but less gentle, in my impression.

Measure theory is good to know, but it's quite different from set theory and logic, and doesn't require you to know them. You don't necessarily have to learn it last, and from my perspective it's easier and you should learn it first. It's certainly the "foundation of some maths" in the sense that it's a fundamental tool in analysis, but most of the time I think people use "foundations of math" to refer just to set theory and logic.

Comment author: jsalvatier 25 October 2010 12:28:06AM 0 points [-]

Can you say why you think it should be learned first? The measure theory I have seen seems to always involve sets (measurable functions, sigma-algebras etc), maybe I am just confused about something.

Comment author: [deleted] 25 October 2010 01:18:58AM *  3 points [-]

Of course it involves sets, but the kind of set theory you need for that is rather limited, because measure theory deals with very special cases, compared to which set theory proper looks pathological. So, it's a prerequisite to know about countable and uncountable, union and intersection, open and closed and compact, but not the contents of a course in set theory, which gets quite a bit more complicated. I know very little set theory and never studied logic.

Edit: nhamann is right, you need a first course in analysis before you'll understand measure theory. I used Rudin, but I'm not partisan in favor of it. But you've got to learn analysis first. Or you will get confused. Do not pass Go, do not collect $200.

The thing about foundations is that they're mysterious, even at the research level, but when you're working on classical special cases it doesn't matter. In the same way that you can do arithmetic even though you can't prove the axioms of arithmetic are consistent. Measure spaces are very much nicer than sets. And often it's safe to think of the reals as a guiding example. In set theory, thinking of familiar sets as guiding examples is dangerous, which is why I think it's a harder subject, but that may be my idiosyncrasy. The point is, measure theory and set theory are independent from the point of view of the learner -- learn whichever you like first, but one isn't a prerequisite for the other.

Comment author: ThomasR 27 October 2010 07:39:52AM *  2 points [-]

A very excellent recent book, with fascinating new ideas and superior readable intros into many themes, is the new edition of Manin's "course in mathematical logic". So I'd recommend that. But: Why "foundations"? Like "foundational themes" in th. physics, "foundations" are not an appropriate place to start, they are a bundle of very advanced research areas whose intuitions and ideas come from core fields of research. "Foundations" in the sense of "what is it, really?" can be exprerienced probably much better by studying a good piece of core math, like number theory. Cox' "Primes of the form x^2 +n*y^2" or Khinchin's "Three Pearls of Number Theory" is what I would suggest. If your mind prefers geometry, I'd suggest to browse a good library for some of the great projective geometry textbooks from the early 20th century.

Comment author: jsalvatier 25 October 2010 02:44:50AM 0 points [-]

That was very informative.

Comment author: Bobertron 24 October 2010 07:47:24PM 1 point [-]

measure theory is part of the foundations of math?

Comment author: jsalvatier 24 October 2010 08:18:19PM *  0 points [-]

Perhaps not, but one of the topics I am interested in (probability) relies on it. Maybe foundations of math refers to something more technical than I knew, but measure theory is the foundation of some maths, right?

Comment author: nhamann 25 October 2010 12:40:56AM *  3 points [-]

The problem with that reasoning is that all theories are the foundation of some maths. Your post is probably better titled "Learning the fundamentals of math" as opposed to "foundations", which evokes things like metamathematics and logic and computability foundational issues.

Comment author: PeterS 31 October 2010 08:38:33AM 0 points [-]

Set Theory and the Continuum Hypothesis by Paul Cohen is good, and starts from a pretty low level if I recall, but you'll want experience in formal reasoning before reading through it. Do you have any experience with formal math?

Comment author: XiXiDu 25 October 2010 10:57:26AM 0 points [-]
Comment author: [deleted] 29 June 2011 01:00:32AM 1 point [-]

At the risk of performing necromancy, I'd like to point out that the video was highly contested afterward on the IAS Foundations of Mathematics mailing list. Many people thought the talk wasn't a reasonable explanation of the current state of affairs in FOM.

I'm not an expert in this, however.

Comment author: jsalvatier 14 November 2010 01:37:54AM 0 points [-]

This video turned out to be very interesting (to my naive eyes anyway). It also gives a nice description of formal theories.

Comment author: jsalvatier 24 October 2010 07:40:28PM *  0 points [-]

This LW thread seems relevant.

In particular this summary of resources has sections on logic and foundations. There's a little bit of difference between that thread topic and my topic, which is that I am interested in learning the fundamentals of math for themselves (and doing further math) rather than only LW relevant math.

Comment author: Vladimir_M 24 October 2010 08:13:43PM *  1 point [-]

The links I posted in that thread are, to my knowledge, the best free online resources. If you go through Cook's lecture notes, and then continue with the foundations text by Podnieks, it will be pretty much what you're looking for, up to and including the basics of set theory. I'm not familiar with literature in measure theory, though.

Regarding your stated preferences, I'm not sure if you can find math textbooks that use formal context-free grammar to define well-formed formulas. However, it's typically done using recursive definitions that are trivial to formalize as CFGs, so it shouldn't be a problem. In addition, I don't understand what benefit you see in formalizations of propositional logic with only two operators. It will just complicate the exposition and make it less understandable. (And why stop there? You can do it with only one.)

Comment author: jsalvatier 24 October 2010 08:27:30PM *  0 points [-]

Your road map is helpful. Thanks :)

I didn't mean to say that you couldn't use what you had derived later on, but if you can define a theory with with 1 operator, why do it with more? Is there a formal concept of an alias in math (for example, "a implies b" could be an alias for "(not a) or b")?

Comment author: Vladimir_M 24 October 2010 09:22:24PM *  2 points [-]

jsalvatier:

I didn't mean to say that you couldn't use what you had derived later on, but if you can define a theory with with 1 operator, why do it with more?

Because it's far easier to work that way. You don't need ten different digits to work with natural numbers either, but we still do it for convenience. When you see the formula (p&q)->r, it's much easier to figure out what's going on than if it's in the form ((p|q)|(p|q))|(r|r). (Here "|" is the Sheffer symbol, i.e. NAND, which is by itself functionally complete.)

Is there a formal concept of an alias in math (for example, "a implies b" could be an alias for "(not a) or b")?

Math texts often introduce some notational aliases to make the text more readable, and logic texts do it almost invariably. For example, in the standard syntax of first-order logic, "+" is a binary function symbol, and "=" is a binary predicate, but it's still customary to introduce easier to read notation "x+y" and "x=y" where it should be "+xy" and "=xy". However, these conventions don't have any implications for the actual results being proven and discussed; the theorems still talk about formulas containing "+xy", and you just translate on the fly between that notation and the intuitive one as necessary.

In contrast, introducing additional operators into your definition of logic formulas changes things significantly, since now all your proofs have to account for these additional sorts of well-formed formulas, and also the formal proof system you use must be able to handle them. On the other hand, a good choice of a non-minimal functionally complete set of operators will make the entire work much easier to handle. So in practice, a non-minimal set is normally used. You can also use notation conventions like p->q instead of (~p v q) as long as their relations with the formal syntax are clear and simple enough. (Which definitely wouldn't be the case if you based the entire logic on just NAND and then tried to define AND, OR, etc. as notational aliases.)

Comment author: jsalvatier 25 October 2010 12:39:38AM 0 points [-]

I hope I am not imposing, but Cook's notes have confused me. The first set introduces a syntax which is fine, but then it introduces semantics and starts using several terms that haven't yet been defined (iff, maps and sets) are these part of meta-theory and conceptually different from being part of propositional logic? What am I missing?

Comment author: Vladimir_M 25 October 2010 01:10:48AM *  0 points [-]

Yes, these are concepts from the meta-theory, i.e. the language in which you speak about the formal logic you're defining. When you define, say, sets of formulas, or maps (i.e. functions) from atoms to truth values, these objects exist outside of the formal system (i.e logic) under discussion.

Now of course, you can ask how come we're talking about sets (and functions and other objects which are sets), when we're just defining the formal logic we'll use to axiomatize the set theory. The answer is that you have to start from somewhere; you can't start speaking if you don't already have a language. For this, you use the existing mathematics whose logical foundations are imperfectly formalized and intuitive. This trails off into deep philosophical issues, but you can look at it this way: before embarking on meta-mathematics, imperfectly formalized mathematics is the most rigorous logical tool available, and we're trying to "turn it against itself," to see what it has to say about its own foundations.

Comment author: jsalvatier 25 October 2010 01:19:46AM 0 points [-]

Does one need meta-theory to work from propositional logic to set theory? Can I safely ignore those parts (perhaps coming back later) if my goal is to learn do theory and not to say something about theory?

Comment author: Vladimir_M 25 October 2010 01:35:54AM 0 points [-]

I'm not sure I understand your question. What exactly would you want to skip, and why?

Comment author: jsalvatier 25 October 2010 02:49:00AM 0 points [-]

The meta-theory parts, so that I am learning just how to make proofs in theory X (e.g. propositional logic), and not learning how to prove things things about theory X proofs. Introduction to Mathematical Logic claims that all theories can be formalized; learning how to work in a theory first and then later possibly coming back to learn how to prove things about proofs in that theory seems like a good way to avoid being confused, and that's largely my goal. Does that clarify?

Comment author: Vladimir_M 25 October 2010 03:28:30AM *  0 points [-]

That depends on what you want to use formal logic for. If you just want some operational knowledge of propositional logic for working with digital circuits, then yes, any digital systems textbook will teach you that much without any complex math. Similarly, you can learn the informal basics of predicate logic by just figuring out how its formulas map onto English sentences, which will enable you to follow its usual semi-formal usage in regular math prose. But if you want to actually study math foundations, then you need full rigor from the start.

Perhaps there is some confusion about what it is precisely that you want to learn. Could you list some concrete mathematical problems and theories that you'd like to understand, or some applications for which you'd like to learn the necessary math?

Comment author: jsalvatier 25 October 2010 12:23:44AM 0 points [-]

I don't understand why this should be significantly easier, but I'll take your word for it; a formal system is a formal system, I suppose.

Comment author: Vladimir_M 25 October 2010 12:48:27AM 0 points [-]

Take the axioms of ZFC, Peano arithmetic, or some other familiar theory and try writing them down in a logic formalism that features only the NAND connective, and you'll see what I'm talking about. (Better yet, try devising a formal proof system using such formalism!)

Comment author: XiXiDu 25 October 2010 08:20:47AM *  0 points [-]

Much updated here: http://lesswrong.com/lw/2un/references_resources_for_lesswrong/

For example: Metamath (Constructs mathematics from scratch, starting from ZFC set theory axioms) and The Haskell Road to Logic, Maths and Programming... and check this graphic: http://space.mit.edu/home/tegmark/toe.gif