Lumifer comments on Self-Congratulatory Rationalism - Less Wrong

51 Post author: ChrisHallquist 01 March 2014 08:52AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (395)

You are viewing a single comment's thread. Show more comments above.

Comment author: Lumifer 24 April 2014 05:08:42PM *  2 points [-]

The answers to your questions are no and no.

I am pretty sure about the second: the possibility space for reconstructing the meaning of someone speaking to you is only manageable if you assume that they're broadly sane, rational, and have mostly true beliefs.

I don't think so. Two counter-examples:

I can discuss fine points of theology with someone without believing in God. For example, I can understand the meaning of the phrase "Jesus' self-sacrifice washes away the original sin" without accepting that Christianity is "mostly true" or "rational".

Consider a psychotherapist talking to a patient, let's say a delusional one. Understanding the delusion does not require the psychotherapist to believe that the patient is sane.

Comment author: TheAncientGeek 24 April 2014 07:19:03PM *  0 points [-]

Mixing truth and rationality is a failure mode. To know whether someone statement is true , you have to understand it,ad to understand it, you have to assume the speaker's rationality.

It's also a failure mode to attach "Irrational" directly to beliefs. A belief is rational if it can be supported by an argument, and you don't carry the space of all possible arguments round jn your head,

Comment author: Lumifer 25 April 2014 12:41:49AM 0 points [-]

A belief is rational if it can be supported by an argument

That's an... interesting definition of "rational".

Comment author: Jayson_Virissimo 25 April 2014 01:31:07AM *  3 points [-]

Puts on Principle of Charity hat...

Maybe TheAncientGreek means:

(1) a belief is rational if it can be supported by a sound argument

(2) a belief is rational if it can be supported by a valid argument with probable premises

(3) a belief is rational if it can be supported by an inductively strong argument with plausible premises

(4) a belief is rational if it can be supported by an argument that is better than any counterarguments the agent knows of

etc...

Although personally, I think it is more helpful to think of rationality as having to do with how beliefs cohere with other beliefs and about how beliefs change when new information comes in than about any particular belief taken in isolation.

Comment author: TheAncientGeek 25 April 2014 08:41:22AM 1 point [-]

There isn't a finite list of rational beliefs, because someone could think of an argument for a belief that you haven't thought of.

There isn't a finite list of correct arguments either. People can invent new ones.

Comment author: Lumifer 25 April 2014 03:25:36AM 0 points [-]

I can't but note that the world "reality" is conspicuously absent here...

Comment author: TheAncientGeek 25 April 2014 08:25:02AM 2 points [-]

That there is empirical evidence for something is good argument for it.

Comment author: Jayson_Virissimo 29 April 2014 09:20:16PM 1 point [-]

I can't but note that the world "reality" is conspicuously absent here...

Arguments of type (1) necessarily track reality (it is pretty much defined this way), (2) may or may not depending on the quality of the premises, (3) often does, and sometimes you just can't do any better than (4) with available information and corrupted hardware.

Just because I didn't use the word "reality" doesn't really mean much.

Comment author: Eugine_Nier 30 April 2014 06:28:23AM 0 points [-]

A definition of "rational argument" that explicitly referred to "reality" would be a lot less useful, since checking which arguments are rational is one of the steps in figuring what' real.

Comment author: Lumifer 30 April 2014 02:41:33PM 0 points [-]

checking which arguments are rational is one of the steps in figuring what' real

I am not sure this is (necessarily) the case, can you unroll?

Generally speaking, arguments live in the map and, in particular, in high-level maps which involve abstract concepts and reasoning. If I check the reality of the stone by kicking it and seeing if my toe hurts, no arguments are involved. And from the other side, classical logic is very much part of "rational arguments" and yet needs not correspond to reality.

Comment author: Eugine_Nier 01 May 2014 04:03:53AM *  1 point [-]

If I check the reality of the stone by kicking it and seeing if my toe hurts, no arguments are involved.

That tends to work less well for things that one can't directly observe, e.g., how old is the universe, or things where there is confounding noise, e.g., does this drug help.

Comment author: Lumifer 01 May 2014 03:00:54PM 0 points [-]

That was a counterexample, not a general theory of cognition...

Comment author: TheAncientGeek 25 April 2014 05:25:07PM 0 points [-]

Well, it's not too compatible with self congratulations "rationality".

Comment author: [deleted] 24 April 2014 06:52:57PM 0 points [-]

I can discuss fine points of theology with someone without believing in God. For example, I can understand the meaning of the phrase "Jesus' self-sacrifice washes away the original sin" without accepting that Christianity is "mostly true" or "rational".

You're not being imaginative enough: you're thinking about someone with almost all true beliefs (including true beliefs about what Christians tend to say), and a couple of sort of stand out false beliefs about how the universe works as a whole. I want you to imagine talking to someone with mostly false beliefs about the subject at hand. So you can't assume that by 'Jesus' self-sacrifice washes away the original sin' that they're talking about anything you know anything about because you can't assume they are connecting with any theology you've ever heard of. Or even that they're talking about theology. Or even objects or events in any sense you're familiar with.

Consider a psychotherapist talking to a patient, let's say a delusional one. Understanding the delusion does not require the psychotherapist to believe that the patient is sane.

I think, again, delusional people are remarkable for having some unaccountably false beliefs, not for having mostly false beliefs. People with mostly false beliefs, I think, wouldn't be recognizable even as being conscious or aware of their surroundings (because they're not!).

Comment author: Lumifer 25 April 2014 12:41:10AM 0 points [-]

People with mostly false beliefs, I think, wouldn't be recognizable even as being conscious or aware of their surroundings (because they're not!).

So why are we talking about them, then?

Comment author: [deleted] 25 April 2014 02:00:14AM *  0 points [-]

Well, my point is that as a matter of course, you assume everyone you talk to has mostly true beliefs, and for the most part thinks rationally. We're talking about 'people' with mostly or all false beliefs just to show that we don't have any experience with such creatures.

Bigger picture: the principle of charity, that is the assumption that whoever you are talking to is mostly right and mostly rational, isn't something you ought to hold, it's something you have no choice but to hold. The principle of charity is a precondition on understanding anyone at all, even recognizing that they have a mind.

Comment author: Jiro 25 April 2014 05:52:43AM 0 points [-]

People will have mostly true beliefs, but they might not have true beliefs in the areas under concern. For obvious reasons, people's irrationality is likely to be disproportionately present in the beliefs with which they disagree with others. So the fact that you need to be charitable in assuming people have mostly true beliefs may not be practically useful--I'm sure a creationist rationally thinks water is wet, but if I'm arguing with him, that subject probably won't come up as much as creationism.

Comment author: [deleted] 25 April 2014 03:02:38PM *  1 point [-]

That's true, but I feel like a classic LW point can be made here: suppose it turns out some people can do magic. That might seem like a big change, but in fact magic will then just be subject to the same empirical investigation as everything else, and ultimately the same integration into physical theory the same as everything else.

So while I agree with you that when we specify a topic, we can have broader disagreement, that disagreement is built on and made possible by very general agreement about everything else. Beliefs are holistic, not atomic, and we can't partition them off while making any sense of them. We're never just talking about some specific subject matter, but rather emphasizing some subject matter on the background of all our other beliefs (most of which must be true).

The thought, in short, is that beliefs are of a nature to be true, in the way dogs naturally have four legs. Some don't, because something went wrong, but we can only understand the defect in these by having the basic nature of beliefs, namely truth, in the background.

Comment author: ChristianKl 25 April 2014 03:51:00PM 1 point [-]

That might seem like a big change, but in fact magic will then just be subject to the same empirical investigation as everything else, and ultimately the same integration into physical theory the same as everything else.

That could be true but doesn't have to be true. Our ontological assumptions might also turn out to be mistaken.

To quote Eliezer:

MORPHEUS: Where did you hear about the laws of thermodynamics, Neo?

NEO: Anyone who's made it past one science class in high school ought to know about the laws of thermodynamics!

MORPHEUS: Where did you go to high school, Neo?

(Pause.)

NEO: ...in the Matrix.

MORPHEUS: The machines tell elegant lies.

(Pause.)

NEO (in a small voice): Could I please have a real physics textbook?

MORPHEUS: There is no such thing, Neo. The universe doesn't run on math.

Comment author: [deleted] 25 April 2014 04:26:49PM *  1 point [-]

That could be true but doesn't have to be true. Our ontological assumptions might also turn out to be mistaken.

True, and a discovery like that might require us to make some pretty fundamental changes. But I don't think Morpheus could be right about the universe's relation to math. No universe, I take it, 'runs' on math in anything but the loosest figurative sense. The universe we live in is subject to mathematical analysis, and what reason could we have for thinking any universe could fail to be so? I can't say for certain, of course, that every possible universe must run on math, but I feel safe in claiming that we've never imagined a universe, in fiction or through something like religion, which would fail to run on math.

More broadly speaking, anything that is going to be knowable at all is going to be rational and subject to rational understanding. Even if someone has some very false beliefs, their beliefs are false not just jibber-jabber (and if they are just jibber-jabber then you're not talking to a person). Even false beliefs are going to have a rational structure.

Comment author: Eugine_Nier 03 May 2014 04:04:50AM 1 point [-]

I can't say for certain, of course, that every possible universe must run on math, but I feel safe in claiming that we've never imagined a universe, in fiction or through something like religion, which would fail to run on math.

That is a fact about you, not a fact about the universe. Nobody could imagine light being both a particle and a wave, for example, until their study of nature forced them to.

Comment author: Jiro 03 May 2014 03:10:40PM 0 points [-]

People could imagine such a thing before studying nature showed they needed to; they just didn't. I think there's a difference between a concept that people only don't imagine, and a concept that people can't imagine. The latter may mean that the concept is incoherent or has an intrinsic flaw, which the former doesn't.

Comment author: [deleted] 03 May 2014 02:17:45PM -1 points [-]

Absolutely, it's a fact about me, that's my point. I just also think it's a necessary fact.

Comment author: TheAncientGeek 25 April 2014 05:05:58PM 1 point [-]

I don't know what you mean by "run on math". Do qualia run in math?

Comment author: [deleted] 25 April 2014 06:26:03PM 0 points [-]

It's not my phrase, and I don't particularly like it myself. If you're asking whether or not qualia are quanta, then I guess the answer is no, but in the sense that the measured is not the measure. It's a triviality that I can ask you how much pain you feel on a scale of 1-10, and get back a useful answer. I can't get at what the experience of pain itself is with a number or whatever, but then, I can't get at what the reality of a block of wood is with a ruler either.

Comment author: ChristianKl 27 April 2014 04:57:17PM *  0 points [-]

More broadly speaking, anything that is going to be knowable at all is going to be rational and subject to rational understanding.

The idea of rational understanding rests on the fact that you are separated from the object that you are trying to understand and the object itself doesn't change if you change your understanding of it.

Then there the halting problem. There are a variety of problems that are NP. Those problems can't be understood by doing a few experiments and then extrapolating general rules from your experiments. I'm not quite firm with the mathematical terminology but I think NP problems are not subject to thinks like calculus that are covered in what Wikipedia describes as Mathematical analysis.

Heinz von Förster makes the point that children have to be taught that "green" is no valid answer for the question: "What's 2+2?". I personally like his German book titled: "Truth is the invention of a liar". Heinz von Förster headed the started the Biological Computer Laboratory in 1958 and came up with concepts like second-order cybernetics.

As far as fictional worlds go, Terry Pratchetts discworld runs on narrativium instead of math.

More broadly speaking, anything that is going to be knowable at all is going to be rational and subject to rational understanding.

That's true as long there no revelations of truth by Gods or other magical processes. In an universe where you can get the truth through magical tarot reading that assumption is false.

Comment author: [deleted] 27 April 2014 09:21:04PM 0 points [-]

The idea of rational understanding rests on the fact that you are separated from the object that you are trying to understand and the object itself doesn't change if you change your understanding of it.

That's not obvious to me. Why do you think this?

That's true as long there no revelations of truth by Gods or other magical processes. In an universe where you can get the truth through magical tarot reading that assumption is false.

I also don't understand this inference. Why do you think revelations of truth by Gods or other magical processes, or tarot readings, mean that such a universe would a) be knowable, and b) not be subject to rational analysis?

Comment author: Lumifer 25 April 2014 04:57:56PM 0 points [-]

we've never imagined a universe, in fiction or through something like religion, which would fail to run on math.

That depends on your definition of "math".

For example, consider a simulated world where you control the code. Can you make it so that 2+2 in that simulation is sometimes 4, sometimes 15, and sometimes green? I don't see why not.

Comment author: RobinZ 25 April 2014 06:53:35PM 2 points [-]

For example, consider a simulated world where you control the code. Can you make it so that 2+2 in that simulation is sometimes 4, sometimes 15, and sometimes green? I don't see why not.

I think you're conflating the physical operation that we correlate with addition and the mathematical structure. 'Green' I'm not seeing, but I could write a computer program modeling a universe in which placing a pair of stones in a container that previously held a pair of stones does not always lead to that container holding a quadruplet of stones. In such a universe, the mathematical structure we call 'addition' would not be useful, but that doesn't say that the formalized reasoning structure we call 'math' would not exist, or could not be employed.

(In fact, if it's a computer program, it is obvious that its nature is susceptible to mathematical analysis.)

Comment author: TheAncientGeek 25 April 2014 06:04:06PM 1 point [-]

Is "containing mathematical truth" the same as "running on math"?

Comment author: [deleted] 25 April 2014 06:29:57PM 0 points [-]

For example, consider a simulated world where you control the code. Can you make it so that 2+2 in that simulation is sometimes 4, sometimes 15, and sometimes green?

I guess I could make it appear that way, sure, though I don't know if I could then recognize anything in my simulation as thinking or doing math. But in any case, that's not a universe in which 2+2=green, it's a universe in which it appears to. Maybe I'm just not being imaginative enough, and so you may need to help me flesh out the hypothetical.