Tyrrell_McAllister comments on How to Convince Me That 2 + 2 = 3 - Less Wrong

52 Post author: Eliezer_Yudkowsky 27 September 2007 11:00PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (381)

Sort By: Old

You are viewing a single comment's thread. Show more comments above.

Comment author: Tyrrell_McAllister 14 September 2011 10:26:58PM 1 point [-]

Is the question "Which beliefs will I end up with if my faculty of logical reasoning is flawed" also of little interest to you?

Comment author: Andreas_Giger 14 September 2011 10:32:59PM *  0 points [-]

Yes, because if I assume that my faculty of logical reasoning is flawed, no deductions of logical reasoning I do can be considered certain, in which case everything falls: Mathematics, physics, bayesianism, you name it. It is therefore (haha! but what if my faculty of logical reasoning is flawed?) very irrational to assume this.

Comment author: Tyrrell_McAllister 14 September 2011 10:39:06PM *  1 point [-]

But you know that your faculty of logical reasoning is flawed to some extent. Humans are not perfect logicians. We manage to find use in making long chains of logical deductions even though we know that they contain mistakes with some nonzero probability.

Comment author: Andreas_Giger 14 September 2011 10:48:57PM *  0 points [-]

I don't know that. Can you prove that under the assumption you're making?

As I see it, my faculty of logical reasoning is not flawed in any way. The only thing that's flawed is my faculty of doing logical reasoning, i.e. I'm not always doing logical reasoning when I should be. But that's hardly the matter here.

I would be very interested in how you can come to any conclusion under the assumption that the logical reasoning you do to come to that conclusion is flawed. If my faculty of logical reasoning is flawed, I can only say one thing with certainty, which is that my faculty of logical reasoning is flawed. Actually, I don't think I could even say that.

Edit:

We manage to find use in making long chains of logical deductions even though we know that they contain mistakes with some nonzero probability.

I don't consider this to be a problem of actual faculty of logical reasoning because if someone finds a logical mistake I will agree with them.

Comment author: Tyrrell_McAllister 14 September 2011 11:27:24PM 1 point [-]

As I see it, my faculty of logical reasoning is not flawed in any way. The only thing that's flawed is my faculty of doing logical reasoning, i.e. I'm not always doing logical reasoning when I should be.

Sorry for not being clear. By "faculty of logical reasoning", I mean nothing other than "faculty of doing logical reasoning".

Comment author: Andreas_Giger 14 September 2011 11:56:19PM 0 points [-]

In that case I have probably answered your original question here.

Comment author: moshez 14 September 2011 11:31:39PM 2 points [-]

So you don't consider mistakes in logical reasoning a problem because someone might point them out to you? What if it's an easy mistake to make, and a lot of other people make the same mistake? At this point, it seems like you're arguing about the definition of the words "problem with", not about states of the world. Can you clarify what disagreement you have about states of the world?

Comment author: Andreas_Giger 14 September 2011 11:51:21PM *  1 point [-]

I don't consider these mistakes to be no problem at all. What I meant to say is that the existence of these noise errors doesn't reduce the reasonabliness of me going around and using logical reasoning to draw deductions. Which also means that if reality seems to contradict my deductions, then either there is an error within my deductions that I can theoretically find, or there is an error within the line of thought that made me doubt my deductions, for example eyes being inadequate tools for counting pebbles. To put it more generally: If I don't find errors within my deductions, then my perception of reality is not an appropriate measure for the truth of my deductions, unless said deductions deal in any way with the applicability of other deductions on reality, or reality in general, which mathematics does not.

It's not as if errors in perceiving reality weren't much more numerous and harder to detect than errors in anyone's faculty of doing logical reasoning.

Comment author: Tyrrell_McAllister 15 September 2011 12:16:13AM *  3 points [-]

It's not as if errors in perceiving reality weren't much more numerous and harder to detect than errors in anyone's faculty of doing logical reasoning.

And the probability of an error in a given logical argument gets smaller as the chain of deductions gets shorter and as the number of verifications of the argument gets larger.

Nonetheless, the probability of error should never reach zero, even if the argument is as short as the proof that SS0 + SS0 = SSSS0 in PA, and even if the proof has been verified by yourself and others billions of times.

ETA: Where ever I wrote "proof" in this comment, I meant "alleged proof". (Erm ... except for in this ETA.)

Comment author: Andreas_Giger 15 September 2011 12:53:41AM *  0 points [-]

the probability of error should never reach zero

The probability that there is an error within the line of thought that lets me come to the conclusion that there is an error within any theorem of peano arithmetic is always higher than the probability that there actually is an error within any theorem of peano arithmetic, since probability theory is based on peano arithmetic and if SS0 + SS0 = SSSS0 were wrong, probability theory would be at least equally wrong.

Comment author: Tyrrell_McAllister 15 September 2011 01:07:27AM *  4 points [-]

the probability that there actually is an error within any theorem of peano arithmetic.

(Emphasis added.) Where ever I wrote "proof" in the grandparent comment, I should have written "alleged proof".

We probably agree that the idea of "an error in a theorem of PA" isn't meaningful. But the idea that everyone was making a mistake the whole time that they thought that SS0 + SS0 = SSSS0 was a theorem of PA, while, all along, SS0 + SS0 = SSS0 was a theorem of PA — that idea is meaningful. After all, people are all the time alleging that some statement is a theorem of PA when it really isn't. That is to say, people make arithmetic mistakes all the time.

Comment author: Andreas_Giger 15 September 2011 01:45:29AM *  0 points [-]

That is true. However, if your perception of reality leads you to the thought that there might be an error with SS0 + SS0 = SSSS0, and you can't find that error, then it is irrational to assume that there actually is an error with SS0 + SS0 = SSSS0 rather than with your perception of rationality or the concept of applying SS0 + SS0 = SSSS0 to reality.

Can we agree on that?

Comment author: ec429 15 September 2011 12:14:15AM 1 point [-]

I think the point is that mathematical reasoning is inherently self-correcting in this sense, and that this corrective force is intentionistic and Lamarckian - it is being corrected toward a mathematical argument which one thinks of as a timeless perfect Form (because come on, are there really any mathematicians who don't, secretly, believe in the Platonic realism of mathematics?), and not just away from an argument that's flawed.

An incorrect theory can appear to be supported by experimental results (with probability going to 0 as the sample size goes to \infty), and if you have the finite set of experimental results pointing to the wrong conclusion, then no amount of mind-internal examination of those results can correct the error (if it could, your theory would not be predictive; conservation of probability, you all know that). But mind-internal examination of a mathematical argument, without any further entangling (so no new information, in the Bayesian sense, about the outside world; only new information about the world inside your head), can discover the error, and once it has done so, it is typically a mechanical process to verify that the error is indeed an error and that the correction has indeed corrected that error.

This remains true if the error is an error of omission (We haven't found the proof that T, so we don't know that T, but in fact there is a proof of T).

So you're not getting new bits from observed reality, yet you're making new discoveries and overthrowing past mistakes. The bits are coming from the processing; your ignorance has decreased by computation without the acquisition of bits by entangling with the world. That's why deductive knowledge is categorically different, and why errors in logical reasoning are not a problem with the idea of logical reasoning itself, nor do they exclude a mathematical statement from being unconditionally true. They just exclude the possibility of unconditional knowledge.

Can you conceive of a world in which, say, ⋀∅ is false? It's certainly a lot harder than conceiving of a world in which earplugs obey "2+2=3"-arithmetic, but is your belief that ⋀∅ unconditional? What is the absolutely most fundamentally obvious tautology you can think of, and is your belief in it unconditional? If not, what kind of evidence could there be against it? It seems to me that ¬⋀∅ would require "there exists a false proposition which is an element of the empty set"; in order to make an error there I'd have to have made an error in looking up a definition, in which case I'm not really talking about ⋀∅ when I assert its truth; nonetheless the thing I am talking about is a tautological truth and so one still exists (I may have gained or lost a 'box', here, in which case things don't work).

My mind is beginning to melt and I think I've drifted off topic a little. I should go to bed. (Sorry for rambling)

Comment author: moshez 15 September 2011 01:15:30AM 0 points [-]

I guess there are my beliefs-which-predict-my-expectations and my aliefs-which-still-weird-me-out. In the sense of beliefs which predict my expectation, I would say the following about mathematics: as far as logic is concerned, I have seen (with my eyes, connected to neurons, and so on) the proof that from P&-P anything follows, and since I do want to distinguish "truth" from "falsehood", I view it as (unless I made a mistake in the proof of P&-P->Q, which I view as highly unlikely -- an easy million-to-one against) as false. Anything which leads me to P&-P, therefore, I see as false, conditional on the possibility I made a mistake in the proof (or not noticed a mistake someone else made). Since I have a proof from "2+2=3" to "2+2=3 and 2+2!=3" (which is fairly simple, and I checked multiple times) I view 2+2=3 as equally unlikely. That's surely entanglement with the world -- I manipulated symbols written by a physical pen on a physical paper, and at each stage, the line following obeyed a relationship with the line before it. My belief that "there is some truth", I guess, can be called unconditional -- nothing I see will convince me otherwise. But I'm not even certain I can conceive of a world without truth, while I can conceive of a world, sadly, where there are mistakes in my proofs :)

Comment author: ec429 15 September 2011 07:04:39PM 0 points [-]

You're missing the essential point about deductives, which is this:

Changing the substrate used for the calculations does not change the experiment.

With a normal experiment, if you repeat my experiment it's possible that your apparatus differs from mine in a way which (unbeknownst to either of us) is salient and affects the outcome.

With mathematical deduction, if our results disagree, (at least) one of us is simply wrong, it's not "this datum is also valid but it's data about a different set of conditions", it's "this datum contains an error in its derivation". It is the same experiment, and the same computation, whether it is carried out on my brain, your brain, your brain using pen and paper as an external single-write store, theorem-prover software running on a Pentium, the same software running on an Athlon, different software in a different language running on a Babbage Analytical Engine... it's still the same experiment. And a mistake in your proof really is a mistake, rather than the laws of mathematics having been momentarily false leading you to a false conclusion. To quote the article, "Unconditional facts are not the same as unconditional beliefs." Contrapositive: conditional beliefs are not the same as conditional facts.

The only way in which your calculation entangled with the world is in terms of the reliability of pen-and-paper single-write storage; that reliability is not contingent on what the true laws of mathematics are, so the bits that come from that are not bits you can usefully entangle with. The bits that you can obtain about the true laws of mathematics are bits produced by computation.