Rationality Quotes April 2014

8 Post author: elharo 07 April 2014 05:25PM

Another month has passed and here is a new rationality quotes thread. The usual rules are:

  • Please post all quotes separately, so that they can be upvoted or downvoted separately. (If they are strongly related, reply to your own comments. If strongly ordered, then go ahead and post them together.)
  • Do not quote yourself.
  • Do not quote from Less Wrong itself, HPMoR, Eliezer Yudkowsky, or Robin Hanson. If you'd like to revive an old quote from one of those sources, please do so here.
  • No more than 5 quotes per person per monthly thread, please.

And one new rule:

  • Provide sufficient information (URL, title, date, page number, etc.) to enable a reader to find the place where you read the quote, or its original source if available. Do not quote with only a name.

Comments (656)

Sort By: Controversial
Comment author: Ian_S 11 April 2014 05:31:05PM *  1 point [-]

"Did many people die?"

"Three thousand four hundred and ninety-two."

"A small proportion."

"It is always one hundred percent for the individual concerned."

"Still..."

"No, no still."

-Ian Banks, Look to Windward

Comment author: shminux 11 April 2014 10:34:13PM 11 points [-]

Does this quote have any rationalist content beyond the usual anti-deathism applause light?

Comment author: Eliezer_Yudkowsky 11 April 2014 11:49:48PM 8 points [-]

And here I looked at that and saw a negative example of how not to do "shut up and multiply", though I suppose it could also be a warning about scope insensitivity / psychophysical numbing if the risk at hand required an absolute payment to stave off, rather than a per-capita payment, since in the former case only absolute numbers matter, and in the latter case per capita risks matter.

Comment author: Nomad 04 April 2014 03:46:08PM 1 point [-]

Teenage stupidity is magical. At that age, you're so dumb that you may think you know you're dumb, but you're actually so ignorant (and arrogant) that you think you're smart and wise for knowing you're dumb. In reality, you're just dumb. Take away the recursive loop of delusion and any sense of how wise you are even though you're so young, and the truth is all that remains: You Are Dumb.

Cracked

Comment author: [deleted] 06 April 2014 02:17:35PM *  16 points [-]

I don't see how that's any different from all the other age groups ;-).

Comment author: B_For_Bandana 03 April 2014 12:27:32AM *  2 points [-]

(Edited to add context)

Context: The speakers work for a railroad. An important customer has just fired them in favor of a competitor, the Phoenix-Durango Railroad.

Jim Taggart [Company president, antagonist]: "What does he expect? That we drop all our other shippers, sacrifice the interests of the whole country and give him all our trains?"

Eddie Willers [Junior exec, sympathetic character]: "Why, no. He doesn't expect anything. He just deals with the Phoenix-Durango."

  • Atlas Shrugged

It gets at the idea talked about here sometimes that reality has no obligation to give you tests you can pass; sometimes you just fail and that's it.

ETA: On reflection, what I think the quote really gets at is that Taggart cannot understand that his terminal goals may be only someone else's instrumental goals, that other people are not extensions of himself. Taggart's terminal goal is to run as many trains as possible. If he can help a customer, then the customer is happy to have Taggart carry his freight, and Taggart's terminal goal aligns with the customer's instrumental goal. But the customer's terminal goal is not to give Taggart Inc. business, but just to get his freight shipped. If the customer can find a better alternative, like competing railroad, he'll switch. For Taggart, of course, that is not a better alternative at all, hence his anger and confusion.

(Apologies for lack of context initially).

Comment author: Cyan 03 April 2014 06:11:28PM 9 points [-]

Without context, it's a bit difficult to see how this is a rationality quote. Not everyone here has read Atlas Shrugged...

Comment author: gwern 03 April 2014 09:19:07PM 3 points [-]

I've read AS a while ago, and I still don't remember enough of the context to interpret this quote...

Comment author: AshwinV 24 April 2014 10:57:00AM 0 points [-]

"Many who are self-taught far excel the doctors, masters and bachelors of the most renowned universities" Ludwig Von Mises

Comment author: More_Right 24 April 2014 07:04:54PM 0 points [-]

Ayn Rand noticed this too, and was a very big proponent of the idea that colleges indoctrinate as much as they teach. While I believe this is true, and that the indoctrination has a large, mostly negative, effect on people who mindlessly accept self-contradicting ideas into their philosophy and moral self-identity, I believe that it's still good to get a college education in STEM. I believe that STEM majors will benefit more from the useful things they learn, more than they will be hurt or held back by the evil, self-contradictory, things they "learn" (are indoctrinated with).

I'm strongly in agreement with libertarian investment researcher Doug Casey's comments on education. I also agree that the average indoctrinated idiot or 'pseudo-intellectual" is more likely to have a college degree than not. Unfortunately, these conformity-reinforcing system nodes then drag down entire networks that are populated by conformists to "lowest-common-denominator" pseudo-philosophical thinking. This constitutes uncritically accepted and regurgitated memes reproduced by political sophistry.

Of course, I think that people who totally "self-start" have little need for most courses in most universities, but a big need for specific courses in specific narrow subject areas. Khan Academy and other MOOCs are now eliminating even that necessity. Generally, this argument is that "It's a young man's world." This will get truer and truer, until the point where the initial learning curve once again becomes a barrier to achievement beyond what well-educated "ultra-intelligences" know, and the experience and wisdom (advanced survival and optimization skills) they have. I believe that even long past the singularity, there will be a need for direct learning from biology, ecosystems, and other incredibly complex phenomena. Ideally, there will be a "core skill set" that all human+ sentiences have, at that time, but there will still be specialization for project-oriented work, due to specifics of a complex situation.

For the foreseeable future, the world will likely become a more and more dangerous place, until either the human race is efficiently rubbed out by military AGI (and we all find out what it's like to be on the receiving end of systemic oppression, such as being a Jew in Hitler's Germany, or a Native American at Wounded Knee), or there becomes a strong self-regulating marketplace, post-enlightenment civilization that contains many "enlightened" "ultraintelligent machines" that all decentralize power from one another and their sub-systems.

I'm interested to find out if those machines will have memorized "Human Action" or whether they will simply directly appeal to massive data sets, gleaned directly from nature. (Or, more likely, both.)

One aspect of the problem now is that the government encourages a lot of people who should not go to college to go to college, skewing the numbers against the value of legitimate education. Some people have college degrees that mean nothing, a few people have college degrees that are worth every penny. Also, the licensed practice of medicine is a perverse shadow of "jumping through regulatory hoops" that has little or nothing to do with the pure, free-market "instantly evolving marketplaces at computation-driven innovation speeds" practice of medicine.

To form a full pattern of the incentives that govern U.S. college education, and social expectations that cause people to choose various majors, and to determine the skill levels associated with those majors, is a very complex thing. The pattern recognition skills inherent in the average human intelligence probably prohibit a very useful emergent pattern from being generated. The pattern would likely be some small sub-aspect of college education, and even then, human brains wouldn't do a very good job of seeing the dominant aspects of the pattern, and analyzing them intelligently.

I'll leave that to I.J. Good's "ultraintelligent machines." Also, I've always been far more of a fan of Hayek, but haven't read everything that both of them have written, so I am reserving final hierarchical placement judgment until then.

Bryan Caplan, Norbert Weiner, Kevin Warwick, Kevin Kelly, Peter Voss in his latest video interview, and Ray Kurzweil have important ideas that enhance the ideas of Hayek, but Hayek and Mises got things mostly right.

Great to see the quote here. Certainly, coercively-funded individuals whose bars of acceptance are very low are the dominant institutions now whose days are numbered by the rise of cheaper, better alternatives. However, if the bar is raised on what constitutes "renowned universities," Mises' statement becomes less true, but only for STEM courses, of which doctors and other licensed professionals are often not participants. Learning how to game a licensing system doesn't mean you have the best skills the market will support, and it means you're of low enough intelligence to be willing to participate in the suppression of your competition.

Comment author: [deleted] 24 April 2014 11:04:57PM *  6 points [-]

You certainly wrote quite a lot of ideological mish-mash to dodge the simplest possible explanation: a, if not the, primary function of elite education (as compared to non-elite education) is to filter out an arbitrary caste of individuals capable of optimizing their way through arbitrarily difficult trials and imbue that caste with elite status. The precise content of the trials doesn't really matter (hence the existence of both Yale and MIT), as long as they're sufficiently difficult to ensure that few pass.

I'm writing from an elite engineering university, and as far as I can tell, this is more-or-less our tacitly admitted pedagogical method: some students will survive the teaching process, and they will retroactively be declared superior. The question of whether we even should optimize our pedagogy to maximize the conveyance of information from professor to student plays no part whatsoever in our curriculum.

Comment author: More_Right 26 April 2014 09:13:28AM 2 points [-]

If you're right (and you may well be), then I view that as a sad commentary on the state of human education, and I view tech-assisted self-education as a way of optimizing that inherently wasteful "hazing" system you describe. I think it's likely that what you say is true for some high percentage of classes, but untrue for a very small minority of highly-valuable classes.

Also, the university atmosphere is good for social networking, which is one of the primary values of going to MIT or Yale.

Comment author: shminux 24 April 2014 11:54:21PM *  1 point [-]

Oft discussed here and is shown to be empirically wrong in math and physics (if you define "excel" as "make notable discoveries"). Probably also wrong in comp. sci., chem and to a lesser degree in engineering. It might still be true in some nascent areas where one does not need 10 years of intense studying to get to the leading edge.

Comment author: TheAncientGeek 30 April 2014 12:39:22PM 2 points [-]

There is one good example of an unschooled mathematician:Ramanujan. The lack of need for special equipment in maths probably has something to do with it.

Comment author: shminux 30 April 2014 03:30:07PM 1 point [-]

Yes, he is definitely an exception. Unfortunately, I cannot think of anyone else in the last 100 years. Possibly because these days anyone brilliant like that ends up in the system. Which is a good thing, if true.

Comment author: RichardKennaway 30 April 2014 11:34:03AM *  2 points [-]

Oft discussed here and is shown to be empirically wrong in math and physics (if you define "excel" as "make notable discoveries"). Probably also wrong in comp. sci., chem and to a lesser degree in engineering.

That sounds like a list of non-diseased disciplines. Is this by chance? Alternatively, it's the STEM subjects. Same thing?

On the other hand, if "excel" is "do well in life" then, I don't know. But that is the reading that the original context of the quote suggests to me:

The emphasis laid by sociologists upon mass phenomena and their idolization of the common man are an offshoot of the myth that all men are biologically equal. Whatever differences exist between individuals are caused, it is maintained, by postnatal circumstances. If all people equally enjoyed the benefits of a good education, such differences would never appear. The supporters of this doctrine are at a loss to explain the differences among graduates of the same school and the fact that many who are self-taught far excel the doctors, masters, and bachelors of the most renowned universities. They fail to see that education cannot convey to pupils more than the knowledge of their teachers. Education rears disciples, imitators, and routinists, not pioneers of new ideas and creative geniuses. The schools are not nurseries of progress and improvement but conservatories of tradition and unvarying modes of thought. The mark of the creative mind is that it defies a part of what it has learned or, at least, adds something new to it. One utterly misconstrues the feats of the pioneer in reducing them to the instruction he got from his teachers. No matter how efficient school training may be, it would only produce stagnation, orthodoxy, and rigid pedantry if there were no uncommon men pushing forward beyond the wisdom of their tutors.

Also an interesting view of education. One of the ancients said that the mind is not a pot to be filled but a fire to be ignited(1), and nobler teachers see the aim of their profession as the igniting of that fire in their students. However, Mises appears to take the view that this is impossible (he does not limit his criticism of education to any time and place), that teaching cannot be anything but the filling of a pot, and the igniting of the fire can come only from the inner qualities of the individual, incapable of being influenced from outside.

(1) As usually quoted. I've just added the original source of this to the quotes thread.

Comment author: shminux 30 April 2014 03:26:26PM -1 points [-]

They fail to see that education cannot convey to pupils more than the knowledge of their teachers.

One of the more popular ideals of education is summarized in this quote from Malcolm Forbes:

Education's purpose is to replace an empty mind with an open one.

Hmm, probably deserves a top-level comment. Anyway, the reality is that some people are happy with imitations, while others strive for creativity:

The mark of the creative mind is that it defies a part of what it has learned or, at least, adds something new to it.

So good education is beneficial to creative types, as well, since to defy something or to add to something, you have to learn that something first.

No matter how efficient school training may be, it would only produce stagnation, orthodoxy, and rigid pedantry if there were no uncommon men pushing forward beyond the wisdom of their tutors.

A bit harsh, given that many people are at least a little bit creative.

igniting of the fire can come only from the inner qualities of the individual, incapable of being influenced from outside.

Not sure if this is Mises' opinion or what he argues against, but, again, seems a bit harsh. There are always the outliers, but for the majority of people this "igniting" is a combination of nature and nurture.

Comment author: [deleted] 25 April 2014 12:50:23PM *  1 point [-]

Many as an absolute number, or many as a fraction of all self-taught people? I'd agree with the former but not with the latter. IME most self-taught people end up with gross misconceptions because of this.

Comment author: AshwinV 30 April 2014 10:08:46AM 1 point [-]

Absolute number. The point of the statement is not the word "many", but rather the rest of the statement. It's sort of an attempt to break the spell that a large amount of money and a fancy college is required for real learning. But yeah, the reference to the double illusion is spot on and is definitely a kink that has to be ironed out with effort and testing.

Comment author: TheAncientGeek 24 April 2014 07:50:43PM 2 points [-]

Some numbers would be useful there.

Comment author: AshwinV 30 April 2014 10:06:48AM 1 point [-]

Numbers would be kind of a nit-pick I would think. The point of the statement is not the word "many", but rather the rest of the statement. It's sort of an attempt to break the spell that a large amount of money and a fancy college is required for real learning.

Comment author: bramflakes 24 April 2014 02:41:00PM 2 points [-]

Correlation/causation? Selection effects?

Comment author: Anders_H 24 April 2014 03:20:34PM 11 points [-]

Neither. Obviously, the average excellence of "doctors, masters and bachelors" of the most renowned universities is higher than the average excellence of people who are self-taught. Nobody suggests that being self-taught correlates positively with excellence.

The quotation is still undoubtedly true, because there are many more individuals who are self-taught than individuals who have these credentials. It is also plausible that the variance in excellence among the self-taught is much higher. Therefore, it is trivial to identify self-taught individuals who are more knowledgeable than most highly credentialed university graduates.

In fact, as a doctoral student in applied causal inference at a fairly renowned university, I can identify several self-taught Less Wrong community members who understand causality theory better than I do.

Comment author: Jayson_Virissimo 02 April 2014 09:49:31PM 1 point [-]

Dogs know how to swim, but it’s unlikely they know any truths describing their activities.

-- Richard Fumerton, Epistemology

Comment author: Eliezer_Yudkowsky 09 April 2014 01:18:00AM 1 point [-]

"Go work in AI for a while, then come back and write a book on epistemology," he thought.

Comment author: MugaSofer 08 April 2014 08:50:29AM 4 points [-]

Really? So, say, if I put a bone on the other side of the river, the dog doesn't know that it can swim across?

Comment author: johnlawrenceaspden 04 April 2014 11:31:30PM -2 points [-]

Do dogs not know that bones are nice?

Comment author: RichardKennaway 06 April 2014 07:19:17PM 5 points [-]

Dogs know how to swim, but it’s unlikely they know any truths describing their activities.

How would one tell?

Comment author: Jayson_Virissimo 07 April 2014 09:41:05PM 6 points [-]

How would one tell?

First, you offer them a sequence of bets such that...oh wait.

Comment author: NancyLebovitz 28 April 2014 12:13:12PM -2 points [-]

Students have no shortcomings, they have only peculiarities. The job of a teacher is to turn these peculiarities into advantages.

--Israel Gelfand, found here

Comment author: shminux 28 April 2014 05:54:33PM *  2 points [-]

Far it be for me to argue with Gelfand, but, having done some extensive tutoring, I think that sometimes the best way to "turn these peculiarities into advantages" is to direct the student to a more suitable career path. Face it, some people just naturally suck at math. Sure, they can be drilled to do well on high-school math exams, with many times the effort an average student spends on it (that's what Kumon is great at, drills upon more drills with a gradual progress toward System I-level mastery). But this is a waste of time and effort for everyone involved. Their time and effort is more productively spent on creative writing, dancing, debating or whatever else these "peculiarities" hint at. Math is no exception, of course, it gets all the attention as a hard course because of the unreasonably high requirements relative to other subjects.

Comment author: wisnij 07 April 2014 08:40:29PM 3 points [-]

Beware of bugs in the above code; I have only proved it correct, not tried it.

Donald Knuth on the difference between theory and practice.

Comment author: Oscar_Cunningham 08 April 2014 08:32:00AM 3 points [-]
Comment author: TheAncientGeek 26 April 2014 03:50:34PM *  -2 points [-]

"The most amazing thing about philosophy is that even though no nobody knows to do it, and even though it has never achieved anything, it is still possible to do it really badly"

--Oolon Kaloophid

Comment author: DanArmak 26 April 2014 04:27:59PM *  4 points [-]

eve though no inebkniws hi

Is there missing context, or did a cat philosopher walk across your keyboard? Or is it meant to evoke "writing but really badly"?

Also: strongly disagree that "it has never achieved anything". See also, "successful philosophy stops being philosophy and becomes another science" (not an exact quote).

Comment author: More_Right 26 April 2014 10:20:24AM 2 points [-]

The ultimate result of shielding men from the results of folly is to fill the world with fools.

 — Herbert Spencer (1820-1903), ”State Tampering with Money and Banks“ (1891)
Comment author: DanArmak 26 April 2014 04:32:51PM *  5 points [-]

Or with smart people who profit at the state's expense when it rescues fools from their mistakes. If it's known that folly has no adverse results, people will take more risks.

Comment author: RolfAndreassen 29 April 2014 06:33:24AM 2 points [-]

While this is true, it may also be the case that humans in the default state don't take enough risks. Indeed, an inventor or entrepreneur bears all the costs of bankruptcy but captures only some of the benefits of a new business. By classical economic logic, then, risk-taking is a public good, and undersupplied. Which said, admittedly, not all risk-taking is created equal.

Comment author: wedrifid 29 April 2014 01:26:52PM *  2 points [-]

Indeed, an inventor or entrepreneur bears all the costs of bankruptcy

This premise doesn't seem true (for all that the conclusion is accurate). Our entire notion of bankruptcy serves the purpose of putting limits on the cost of those risks, transferring burden onto creditors. An example of an alternate cultural construct that come closer to making the entrepreneur bear all the costs of the risk is debt slavery. Others include various forms of formal or informal corporal or capital punishments applied to those that cannot pay their debts.

Comment author: Lumifer 29 April 2014 02:52:44PM 7 points [-]

Indeed, an inventor or entrepreneur bears all the costs of bankruptcy

That's exactly wrong. Bankruptcy releases the entrepreneur from his obligations and transfers the costs to his creditors.

Not to say that the bankruptcy is painless, but its purpose is precisely to lessen the consequences of failure.

Comment author: RolfAndreassen 30 April 2014 01:21:04AM 0 points [-]

The inventor is still bearing the costs of the bankruptcy. The creditors are bearing (some of) the costs of the failure, which is not the same thing.

Comment author: jd_k 29 April 2014 12:57:38PM -1 points [-]

That seems right, and it also seems as though the opposite is sometimes right. If a company knows it can reap the benefits of operations (e.g., of product sales) without bearing the cost of those risks associated with its operations (e.g., of pollution), is this a case of risk-taking being oversupplied?

Comment author: RolfAndreassen 30 April 2014 01:22:09AM 1 point [-]

Pollution does not seem particularly well described by risk or risk-taking; it basically a certainty with industrial operations.

Comment author: jd_k 30 April 2014 07:27:33PM -1 points [-]

In the same way that "product sales" was intended to refer to the result (income), "pollution" was intended to refer to the result (health problems, etc.). While one might think that some result is basically a certainty, the scope and degree of real problems is frequently uncertain. An entrepreneur who weighs potential public health risks does not seem any more difficult to imagine than one who weighs potential bankruptcy risks.

At any rate, pollution is merely an example; you can take any other example you find more suitable.

Comment author: Eugine_Nier 02 April 2014 01:18:13AM 4 points [-]

General Principle: the solutions (on balance) need to be simpler than the problems.

(Otherwise the system collapses under its complexity).

Nassim Taleb

Comment author: johnlawrenceaspden 16 April 2014 12:49:55AM 1 point [-]

flying vs aeroplanes?

Comment author: Eugine_Nier 02 April 2014 01:20:23AM 5 points [-]

Instead of journalism progressing into becoming more scientific, it is that science that is becoming more an more journalistic.

Nassim Taleb

Comment author: shminux 30 April 2014 03:08:13PM *  -2 points [-]

Education's purpose is to replace an empty mind with an open one.

Attributed to Malcolm Forbes.

Comment author: Anders_H 30 April 2014 10:05:42PM 4 points [-]

If it weren't for the ban on Robin Hanson quotes, the appropriate response would be too obvious..

That said, I really wish I lived in a world where that quotation was true.

Comment author: johnlawrenceaspden 04 April 2014 11:24:09PM *  -2 points [-]

Eadem Mutata Resurgo

[the] Same, [but] Changed, I [shall] Rise

On the tombstone of Jacob Bernoulli.

Comment author: gjm 16 April 2014 10:26:00PM 4 points [-]

Some context may be useful. (Sadly, the people who made the tombstone screwed up[1] and put the wrong sort of spiral on it.)

[1] I suppose this is a rather clever pun, but only by coincidence.

Comment author: johnlawrenceaspden 17 April 2014 12:36:11AM 1 point [-]

Voted up for the pun! I liked it for the cryonics reference. Like in Lovecraft.

Comment author: elharo 01 April 2014 11:30:09AM *  8 points [-]

it's like arguing that fairies are coming out of my toaster in the middle of the night. You can't prove to me that there aren't fairies in my toaster, but that doesn't mean you should take me seriously. What I have a problem with is not so much religion or god, but faith. When you say you believe something in your heart and therefore you can act on it, you have completely justified the 9/11 bombers. You have justified Charlie Manson. If it's true for you, why isn't it true for them? Why are you different? If you say "I believe there's an all-powerful force of love in the universe that connects us all, and I have no evidence of that but I believe it in my heart," then it's perfectly okay to believe in your heart that Sharon Tate deserves to die. It's perfectly okay to believe in your heart that you need to fly planes into buildings for Allah.

--Penn Jillette in "Penn Jillette Is Willing to Be a Guest on Adolf Hitler's Talk Show, Vanity Fair, June 17, 2010

Comment author: ChristianKl 01 April 2014 12:25:42PM 1 point [-]

You have justified Charlie Manson. If it's true for you, why isn't it true for them?

That leaves the question of how Penn actually knows that Chalie Manson was acting based on what his heart was telling him.

Psychopaths are frequently bad at empathy or "listening to their hearts". It might even be the defining characteristic of what makes someone a psychopath.

Comment author: tegid 01 April 2014 02:44:48PM 1 point [-]

You missed the point entirely. 'Listening to their (own) hearts' is not empathy, it's just giving credibility to your instinctive beliefs, regardless of wether they have a basis or not. How is believing that everyone is connected by a network of magical energy tethers and acting according to that any different than believing that my soul will be saved if I massacre 40 people and acting on that?

The only difference is the actual acts that you take due to the beliefs. Mind you, it's a very important difference, but the quote is not talking about that, it's talking about beliefs themselves and using them as a sufficient justification for acts.

Comment author: ChristianKl 01 April 2014 09:06:26PM -2 points [-]

Listening to their (own) hearts' is not empathy, it's just giving credibility to your instinctive beliefs, regardless of wether they have a basis or not.

I think that plenty of people who call themselves rationalists simply have no idea what listening to one's own heart actually means.

It's like talking with a blind man who has no concept about how green differs from red about how one using a traffic light, to decide when to stop your car. You mean at on time one lamp shown you that you have to stop and at another time it tells you to go ahead? How do you tell the difference?

How is believing that everyone is connected by a network of magical energy tethers and acting according to that any different than believing that my soul will be saved if I massacre 40 people and acting on that?

You basically left out the part about listening to your heart. Having a cognitive belief and making decisions based on mental analysis of the consequences of the belief is not what listening to one's heart is about.

If a human tries to murder another, certain automatic programming fires that dissuades the human from killing. Emotions come up. If you listen to them, you won't kill. You actually have to refuse to listen to your heart to be capable of killing. Maybe there are a few Buddhists who manage to be in a complete state of pure heartfelt love while they ram a knife into someone's else heart but that's very far from what 99.99% of the population is capable of.

In the military soldiers get trained to disassociate the emotions that prevent them from killing others. Psychopaths usually do have a bunch of beliefs about morals. What they lack is the ability to listen to their hearts in a way that guides their actions.

The philosophers of ethics steal more books than other philosophers. It's not clear that well thought out moral beliefs are useful for preventing people from engaging in immoral actions.

The only difference is the actual acts that you take due to the beliefs.

No. Whether or someone is in their head or listens to their heart can matter to the people around him, if those people are perceptive enough to tell the difference. It probably effects most people on an unconscious level.

Comment author: JQuinton 01 April 2014 09:19:12PM 1 point [-]

Listening to your heart just means listening to your innermost desires. It has nothing to do with empathy. Meaning that psychopaths listen to their heart just as much as anyone else. I've never heard anyone use the idiom "listen to your heart" to mean to practice empathy.

Comment author: DanArmak 01 April 2014 06:36:14PM 8 points [-]

Mr. Potter, in the end people all do what they want to do. Sometimes people gives names like 'right' to the things they want to do, but how could we possibly act on anything but our own desires?

-- Rational!Quirrel, HPMoR chapter 20

In other words: how else can you justify a moral belief and consequent actions, except by saying that you really truly believe in your heart that you're Right?

We should not confuse between the fact that almost all people other than Manson think he was morally wrong, and the fact that his justification for his action seems to me to be of the same kind as the justifications anyone else ever gives for their moral beliefs and actions.

Comment author: SaidAchmiz 01 April 2014 09:14:54PM *  6 points [-]

Unlike Quirrell, Penn Jillette is not referring to "knowing in your heart" that your moral values are correct, but to "knowing in your heart" some matters of fact (which may then serve as a justification for having some moral values, or directly for some action).

Comment author: DanArmak 02 April 2014 08:16:04AM 2 points [-]

If you're a moral realist, and you think moral opinions are statements of fact (which may be right or wrong), then you think it's possible to "know in your heart" moral "facts".

If you're a moral anti-realist (like me), and you think moral opinions are statements of preferences (in other words, statements of fact about your own preferences and your own brain-wiring), then all moral opinions are such. And then surely Manson's statement of his preferences has the same status as anyone else's, and the only difference is that most people disagree with Manson.

What else is there?

However, it's true that Jillette talks about factual amoral beliefs like fairies and gods. So my comment was somewhat misdirected. I still think it's partly relevant, because people who believe in gods (i.e. most people) usually tie them closely to their moral opinions. It's impossible to discuss morals (of most humans) without discussing religious beliefs.

Comment author: Mestroyer 01 April 2014 08:20:23PM 17 points [-]

This quote seems like it's lumping every process for arriving at beliefs besides reason into one. "If you don't follow the process I understand and is guaranteed not to produce beliefs like that, then I can't guarantee you won't produce beliefs like that!" But there are many such processes besides reason, that could be going on in their "hearts" to produce their beliefs. Because they are all opaque and non-negotiable and not this particular one you trust not to make people murder Sharon Tate, does not mean that they all have the same probability of producing plane-flying-into-building beliefs.

Consider the following made-up quote: "when you say you believe something is acceptable for some reason other than the Bible said so, you have completely justified Stalin's planned famines. You have justified Pol Pot. If it's acceptable for for you, why isn't it acceptable for them? Why are you different? If you say 'I believe that gays should not be stoned to death and the Bible doesn't support me but I believe it in my heart', then it's perfectly okay to believe in your heart that dissidents should be sent to be worked to death in Siberia. It's perfectly okay to believe because your secular morality says so that all the intellectuals in your country need to be killed."

I would respond to it: "Stop lumping all moralities into two classes, your morality, and all others. One of these lumps has lots of variation in it, and sub-lumps which need to be distinguished, because most of them do not actually condone gulags"

And likewise I respond to Penn Jilette's quote: "Stop lumping all epistemologies into two classes, yours, and the one where people draw beliefs from their 'hearts'. One of these lumps has lots of variation in it, and sub-lumps which need to be distinguished, because most of them do not actually result in beliefs that drive them to fly planes into buildings."

The wishful-thinking new-age "all powerful force of love" faith epistemology is actually pretty safe in terms of not driving people to violence who wouldn't already be inclined to it. That belief wouldn't make them feel good. Though of course, faith plus ancient texts which condone violence can be more dangerous, though as we know empirically, for some reason, people driven to violence by their religions are rare these days, even coming from religions like that.

Comment author: ChristianKl 01 April 2014 10:20:27PM 1 point [-]

Though of course, faith plus ancient texts which condone violence can be more dangerous

That means you can actually make people less harmful if you tell them to listen to their hearts instead of listening to ancient texts. The person who's completely in their head and analyses the ancient text for absolute guidance of action is dangerous.

A lot of religions also have tricks were the believer has to go through painful exercises. Just look at a Christian sect like Opus Dei with cilices. The kind of religious believer who wears a cilice loses touch with his heart. Getting someone who's in the habit of causing his own body pain with a cilice to harm other people is easier.

Comment author: Desrtopa 01 April 2014 09:41:23PM 1 point [-]

I'd have to disagree here; I think that "faith" is a useful reference class that pretty effectively cleaves reality at the joints, which does in fact lump together the epistemologies Penn Jilette is objecting to.

The fact that some communities of people who have norms which promote taking beliefs on faith do not tend to engage in acts of violence, while some such communities do, does not mean that their epistemologies are particularly distinct. Their specific beliefs might be different, but one group will not have much basis to criticize the grounds of others' beliefs.

The flaw he's arguing here is not "faith-based reasoning sometimes drives people to commit acts of violence," but "faith-based reasoning is unreliable enough that it can justify anything, in practice as well as principle, including acts of extreme violence."

Comment author: ChristianKl 02 April 2014 11:20:59AM 1 point [-]

I'd have to disagree here; I think that "faith" is a useful reference class that pretty effectively cleaves reality at the joints, which does in fact lump together the epistemologies Penn Jilette is objecting to.

People who follow the moral code of the Bible versus peopel that don't is also a pretty clear criteria that separates some epistemologies from others.

The fact that some communities of people who have norms which promote taking beliefs on faith do not tend to engage in acts of violence, while some such communities do, does not mean that their epistemologies are particularly distinct.

People who uses a pendulum to make decisions as a very different epistemology than someone who thinks about what the authorities in his particular church want him to do and acts accordingly.

"faith-based reasoning is unreliable enough that it can justify anything, in practice as well as principle, including acts of extreme violence."

The kind of people who win the world debating championship also haave no problem justying policies like genocide with rational arguments that win competive intellectual debates.

Justifying actions is something different than decision criteria.

Comment author: Desrtopa 02 April 2014 01:57:14PM *  1 point [-]

People who follow the moral code of the Bible versus peopel that don't is also a pretty clear criteria that separates some epistemologies from others.

Yes, but then you can go a step down from there, and ask "why do you believe in the contents of the bible?" For some individuals, this will actually be a question of evidence; they are prepared to reason about the evidence for and against the truth of the biblical narrative, and reject it given an adequate balance of evidence. They're generally more biased on the question than they realize, but they are at least convinced that they must have adequate evidence to justify their belief in the biblical narrative.

I have argued people out of their religious belief before (and not just Christianity,) but never someone who thought that it was correct to take factual beliefs that feel right "on faith" without first convincing them that this is incorrect as a general rule, not simply in the specific case of religion. This is an epistemic underpinning which unites people from different religions, whatever tenets or holy books they might ascribe to. I've also argued the same point with people who were not religious; it's not simply a quality of any particular religion, it's one of the most common memetic defenses in the human arsenal.

Comment author: Nate_Gabriel 02 April 2014 01:30:26PM *  3 points [-]

I don't think it's lumping everything together. It's criticizing the rule "Act on what you feel in your heart." That applies to a lot of people's beliefs, but it certainly isn't the epistemology of everyone who doesn't agree with Penn Jillette.

The problem with "Act on what you feel in your heart" is that it's too generalizable. It proves too much, because of course someone else might feel something different and some of those things might be horrible. But if my epistemology is an appeal to an external source (which I guess in this context would be a religious book but I'm going to use "believe whatever Rameses II believed" because I think that's funnier), then that doesn't necessarily have the same problem.

You can criticize my choice of Rameses II, and you probably should. But now my epistemology is based on an external source and not just my feelings. Unless you reduce me to saying I trust Rameses because I Just Feel that he's trustworthy, this epistemology does not have the same problem as the one criticized in the quote.

All this to say, Jillette is not unfairly lumping things together and there exist types of morality/epistemology that can be wrong without having this argument apply.

Comment author: Mestroyer 02 April 2014 03:46:24PM 2 points [-]

The problem with "Act on what you feel in your heart" is that it's too generalizable. It proves too much, because of course someone else might feel something different and some of those things might be horrible.

It looks like there's all this undefined behavior, and demons coming out the nose from the outside because you aren't looking at the exact details of what's going on in with their feelings that are choosing the beliefs. Though a C compiler given an undefined construct may cause your program to crash, it will never literally cause demons to come out of your nose, and you could figure this out if you looked at the implementation of the compiler. It's still deterministic.

As an atheistic meta-ethical ant-realist, my utility function is basically whatever I want it to be. It's entirely internal. From the outside, from someone who has a system where they follow something external and clearly specified, they could shout "Nasal demons!", but demons will never come out my nose, and my internal, ever so frighteningly non-negotiable desires are never going to include planned famines. It has reliable internal structure.

The mistake is looking at a particular kind of specification that defines all the behavior, and then looking at a system not covered by that specification, but which is controlled by another specification you haven't bothered to understand, and saying "Who can possibly say what that system will do?"

Some processors (even x86) have instructions (such as bit rotate) which are useful for significant performance boosts in stuff like cryptography, and yet aren't accessible from C or C++, and to use it you have to perform hacks like writing the machine code out as bytes, casting its address to a function pointer and calling it. That's undefined behavior with respect to the C/C++ standard. But it's perfectly predictable if you know what platform you're on.

Other people who aren't meta-ethical anti-realists' utility functions are not really negotiable either. You can't really give them a valid argument that will convince them not to do something evil if they happen to be psychopaths. They just have internal desires and things they care about, and they care a lot more about having a morality which sounds logical when argued for than I do.

And if you actually examine what's going on with the feelings of people with feeling-driven epistemology that makes them believe things, instead of just shouting "Nasal demons! Unspecified behavior! Infinitely beyond the reach of understanding!" you will see that the non-psychopathic ones have mostly-deterministic internal structure to their feelings that prevents them from believing that they should murder Sharon Tate. And psychopaths won't be made ethical by reasoning with them anyway. I don't believe the 9/11 hijackers were psychopaths, but that's the holy book problem I mentioned, and a rare case.

In most cases of undefined C constructs, there isn't another carefully-tuned structure that's doing the job of the C standard in making the behavior something you want, so you crash. And faith-epistemology does behave like this (crashing, rather than running hacky cryptographic code that uses the rotate instructions) when it comes to generating beliefs that don't have obvious consequences to the user. So it would have been a fair criticism to say "You believe something because you believe it in your heart, and you've justified not signing your children up for cryonics because you believe in an afterlife," because (A) they actually do that, (B) it's a result of them having an epistemology which doesn't track the truth.

Disclaimer: I'm not signed up for cryonics, though if I had kids, they would be.

Comment author: shminux 29 April 2014 03:05:31PM 3 points [-]

I reject the concept of "me" as some sort of static thing. Instead I see my moist robot container as something I can manipulate to engineer my mood to the situation. There are times when having more ego is useful. There are times when it is better to be humble. I jack my body chemistry as needed.

Scott Adams on consciously controlling your own moods and feelings

Comment author: Eugine_Nier 02 April 2014 01:21:46AM 15 points [-]

A BS detection Heuristic.

You can tell if a discipline is BS if the degree depends severely on the prestige of the school granting it. I remember when I applied to MBA programs being told that anything outside the top 10 or 20 would be a waste of time. On the other hand a degree in mathematics is much less dependent on the shool (conditional on being above a certain level, so the heuristic would apply to the differene betwewn top 10 and top 2000 schools).

The same applies to research papers. In math and physics, a result posted on arXiv (with a minimum hurdle) is fine. In low quality fields like academic finance (where almost all academics are charlatans and all papers some form of complicated storytelling), the "prestige" of the journal is the sole criterion.

Nassim Taleb

Comment author: shminux 03 April 2014 08:55:16PM *  7 points [-]

This seems false in physics. Prestige of your institution matters. Prestige of the journal matters, too. Arxiv is fine, Physical Reviews is better, PRL is better yet. Nature/Science is so high, if you publish something that is not perceived as top-quality, you may get resented by others for status jumping. And there are plenty of journals which only get to publish second- and third-rate results.

Of course, the usual countersignaling caveat applies: once you have enough status, posting on Arxiv is enough, you will get read. Not submitting to journals can be seen as a sign of status, though I don't think the field is there (yet).

Comment author: Eugine_Nier 04 April 2014 02:43:10AM 9 points [-]

My understating is that this effect is a lot smaller in physics than in the humanities.

Comment author: VAuroch 05 April 2014 04:48:38AM 4 points [-]

By that standard, all academic disciplines are BS disciplines.

Comment author: MugaSofer 04 May 2014 01:43:39PM *  1 point [-]

I believe that is the intended meaning, yes.

Comment author: VAuroch 04 May 2014 06:47:58PM -1 points [-]

Can't be. You can't draw a distinction within a category by separating it into two subcategories one of which is empty.

Comment author: MugaSofer 06 May 2014 08:03:38PM 1 point [-]

The category being separated is "disciplines", which divides into "BS" and "non-BS". "Academic" disciplines are thus a further subcategory of "BS" disciplines.

Actually, "academic" disciplines would probably be a subcategory of "disciplines" which is largely but not entirely subsumed by "BS" disciplines, but I don't usually demand that level of precision from witticisms.

[For the record, separating a category into two subcategories and proving one of them empty is just another way of proving the original category is identical with the non-empty subcategory. It is, indeed, valid from a technical perspective.]

Comment author: [deleted] 04 May 2014 07:03:37PM *  2 points [-]

You can, though it's usually useless; but it also depends on whether that subcategory is always necessarily empty or it happens to be empty now but in principle it could be non-empty.

(But it's still a fallacy of grey: even if all academic disciplines were, in fact, BS disciplines, some disciplines may still be less BS than others.)

Comment author: Armok_GoB 17 May 2014 08:18:34PM 5 points [-]

It wasn’t easier, the ghost explains, you just knew how to do it. Sometimes the easiest method you know is the hardest method there is.

It’s like… to someone who only knows how to dig with a spoon, the notion of digging something as large as a trench will terrify them. All they know are spoons, so as far as they’re concerned, digging is simply difficult. The only way they can imagine it getting any easier is if they change – digging with a spoon until they get stronger, faster, and tougher. And the dangerous people, they’ll actually try this.

Everyone who will ever oppose you in life is a crazy, burly dude with a spoon, and you will never be able to outspoon them. Even the powerful people, they’re just spooning harder and more vigorously than everyone else, like hungry orphan children eating soup. Except the soup is power. I’ll level with you here: I have completely lost track of this analogy.

What I’m saying, giant talking cat, is that everyone is stupid. They attain a narrow grasp of reality and live their life as though there is nothing else. But you, me, creatures with imagination – we aren’t constrained by our experiences. We’re inspired by them. If we have trouble digging with a spoon, we build a shovel. If we’re stopped by a wall, we make a door. And if we can’t make a door, we ask ourselves whether we really need an opening to pass through something solid in the first place.

You point out that you’re not a ghost, and that you do need an opening to pass through solid objects.

No – that’s your mistake, he replies. That’s why you’re still not thinking like a witchhunter. You’re trying to do things right, and that’s wrong. Mysticism means taking a step back – accepting that the very laws of reason and logic you abide by are merely one option of many. It means knowing you only see half the picture in a world where everyone else thinks they see the whole thing. It means having the sheer arrogance to have humility.

That’s why I’m saying you have to think like a witchhunter. You have to be a little wrong to be completely right – to abandon truth in favor of questioning falsehood. If you think something’s the easiest way, you have to know you’re wrong. You have to understand how to stand against the very stance of understanding! You have to know you are inferior; that your knowledge and perceptions will never stand up to the true scope of all possible reality. You have to be a little further from perfect, and embrace that notion.

Source: http://www.prequeladventure.com/2014/05/3391/

Comment author: Visser_One 11 July 2014 04:03:21PM 1 point [-]

thank you for posting this - now I have something new to read!

Comment author: Benito 22 April 2014 09:30:04PM 4 points [-]

Whilst arguing that uncertainty is best measured using numbers and probabilities:

We want to measure uncertainties in order to combine them. A politician said that he preferred adverbs to numbers. Unfortunately it is difficult to combine adverbs.

  • Dennis V. Lindley, Understanding Uncertainty
Comment author: CronoDAS 24 April 2014 07:46:06AM *  1 point [-]

[missing the point]
On the contrary, combining adverbs is easy. If X is very uncertain, and Y is very uncertain, then X - Y is very, very uncertain. [/missing the point]

^_^

Comment author: RolfAndreassen 29 April 2014 06:37:17AM -1 points [-]

Why isn't it "very, very uncertain, uncertain"? Anyway, 'very' is an adjective. 'Verily' is the adverb.

Comment author: Gunnar_Zarncke 10 April 2014 12:13:53PM 0 points [-]

The most significant moment in the course of intellectual development, which gives birth to the purely human forms of practical and abstract intelligence, occurs when speech and practical activity, two previously completely independent lines of development, converge.

1930 Lev Vygotsky in Mind and Society (transcribed by Andy Blunden and Nate Schmolze)

Online: http://www.cles.mlc.edu.tw/~cerntcu/099-curriculum/Edu_Psy/EP_03_New.pdf

Comment author: Jayson_Virissimo 02 April 2014 09:48:40PM *  2 points [-]

-- Meta --

Shouldn't this be in Main rather than Discussion? I PM'ed the author, but didn't get a response.

EDIT: Thanks.

Comment author: Eliezer_Yudkowsky 01 April 2014 05:38:51PM 7 points [-]

Edited OP to make it clear that you can provide a link to the place you found the quote, rather than needing to track down an authoritative original source.

Comment author: lukeprog 09 April 2014 02:02:46AM 12 points [-]

There is nothing that can be said by mathematical symbols and relations which cannot also be said by words. The converse, however, is false. Much that can be and is said by words cannot be put into equations — because it is nonsense.

Clifford Truesdell

Comment author: johnlawrenceaspden 15 April 2014 11:53:36PM 4 points [-]

This is beautiful: I can't turn it into equations. Does that refute it or support it?

Comment author: The_Duck 19 April 2014 06:53:00AM 1 point [-]

I can't turn it into equations.

Did you try? Each sentence in the quote could easily be expressed in some formal system like predicate calculus or something.

Comment author: [deleted] 25 April 2014 08:54:43PM *  -1 points [-]

There are symbol-juxtapositions which are syntactically or semantically disconnected from any model set in ZFC. There are no sets in ZFC which are similarly separated from statements in a suitable language.

Comment author: RolfAndreassen 29 April 2014 06:46:47AM 1 point [-]

I don't see why an equation can't be nonsensical. Perhaps the nonsense is easier to spot when expressed in symbols, or then again perhaps not.

Comment author: lionhearted 08 April 2014 11:03:13PM 5 points [-]

On thrust work, drag work, and why creative work is perpetually frustrating --

"Each individual creative episode is unsustainable by its very nature. As a given episode accelerates, surpassing the sustainable long term trajectory, the thrust engine overwhelms the available supporting capabilities. ... Just as momentum build to truly exciting levels…some new limitation appears squelching that momentum. ...The problem is that you outran your supporting capabilities and that deficit became a source of drag. Perhaps you didn’t have systems in place to capture leads. Perhaps you lacked the bandwidth necessary to follow up on all the new opportunities. Perhaps, due to lack of experience, you pursued the wrong opportunities. Perhaps you just didn’t know what to do next – you outran your existing knowledge base. In one way or another new varieties of drag emerge. The accelerating curve you had been riding becomes unsustainable and you find yourself mired in the slow build of the next episode. This is what we experience as anti-climax and temporary stagnation." -- Greg Raider, from his essay "A Pilgrimage Through Stagnation and Acceleration"

The whole piece is worth reading, it's really good -- http://onthespiral.com/pilgrimage-through-stagnation-acceleration

Hat tip to Zach Obront for linking me to it originally.

Comment author: fezziwig 02 April 2014 12:22:31AM 5 points [-]

"There are people out there that call themselves Cooks. But that doesn't make them Cooks. They say they're Cooks because they've heard about Cooks and they want to be Cooks. But they're not. Do you understand that?"

"Scip, where you think org'nizations come from? If they say they're Cooks and they do people like Cooks, that makes 'em goddam Cooks."

"Cooks are a specific thing, Reagan, not an idea."

"You don't even think they're real!"

"They don't have to be real to have a definition."

-- Reagan and Scipio debate the nature of definitions. From Templar, Arizona

Comment author: Gunnar_Zarncke 16 April 2014 10:32:50PM 6 points [-]

Our recent research into team behavior [...] reveals an interesting paradox: Although teams that are large, virtual, diverse, and composed of highly educated specialists are increasingly crucial with challenging projects, those same four characteristics make it hard for teams to get anything done. To put it another way, the qualities required for success are the same qualities that undermine success. Members of complex teams are less likely—absent other influences—to share knowledge freely, to learn from one another, to shift workloads flexibly to break up unexpected bottlenecks, to help one another complete jobs and meet deadlines, and to share resources—in other words, to collaborate. They are less likely to say that they “sink or swim” together, want one another to succeed, or view their goals as compatible.

Eight Ways to Build Collaborative Teams by Lynda Gratton and Tamara J. Erickson

This seems applicable as the LessWrong community is "large, virtual, diverse, and composed of highly educated specialists" and the community wants to solve challenging projects.

Comment author: Stefan_Schubert 01 April 2014 02:36:23PM *  7 points [-]

The representatives of the scientific world-conception resolutely stand on the ground of simple human experience. They confidently approach the task of removing the metaphysical and theological debris of millennia. Or, as some have it: returning, after a metaphysical interlude, to a unified picture of this world which had, in a sense, been at the basis of magical beliefs, free from theology, in the earliest times.

The increase of metaphysical and theologizing leanings which shows itself today in many associations and sects, in books and journals, in talks and university lectures, seems to be based on the fierce social and economic struggles of the present: one group of combatants, holding fast to traditional social forms, cultivates traditional attitudes of metaphysics and theology whose content has long since been superseded; while the other group, especially in central Europe, faces modern times, rejects these views and takes its stand on the ground of empirical science. This development is connected with that of the modern process of production, which is becoming ever more rigorously mechanised and leaves ever less room for metaphysical ideas. It is also connected with the disappointment of broad masses of people with the attitude of those who preach traditional metaphysical and theological doctrine. So it is that in many countries the masses now reject these doctrines much more consciously than ever before, and along with their socialist attitudes tend to lean towards a down-to-earth empiricist view. In previous times, materialism was the expression of this view; meanwhile, however, modern empiricism has shed a number of inadequacies and has taken a strong shape in the scientific world-conception.

Thus, the scientific world-conception is close to the life of the present. Certainly it is threatened with hard struggles and hostility. Nevertheless there are many who do not despair but, in view of the present sociological situation, look forward with hope to the course of events to come. Of course not every single adherent of the scientific world-conception will be a fighter. Some, glad of solitude, will lead a withdrawn existence on the icy slopes of logic; some may even disdain mingling with the masses and regret the ‘trivialized’ form that these matters inevitably take on spreading. However, their achievements too will take a place among the historic developments. We witness the spirit of the scientific world-conception penetrating in growing measure the forms of personal and public life, in education, upbringing, architecture, and the shaping of economic and social life according to rational principles. The scientific world-conception serves life, and life receives it.

Comment author: Protagoras 01 April 2014 04:29:06PM 1 point [-]

Cool! I've looked for that manifesto on line before, and failed to find it; thanks for the link! Too many people seem to get all of their knowledge of the Vienna Circle and Logical Positivism from its critics. It's good to look at the primary sources. The translation is a little clunky (perhaps too literal), but so much better than not having it available at all.

Comment author: Stefan_Schubert 01 April 2014 04:56:53PM 2 points [-]

The translation is a little clunky (perhaps too literal), but so much better than not having it available at all.

I agree.

The Logical Positivists were, to my mind, the greatest philosophers ever, and it's a shame they have been the target of so much unfair criticism. Of course they were wrong on many issues, but their attitude towards philosophy, knowledge and political action is unsurpassed. If we can revive their spirit again, philosophy will have a bright future.

Comment author: ChristianKl 02 April 2014 11:07:34AM 0 points [-]

The Logical Positivists were, to my mind, the greatest philosophers ever, and it's a shame they have been the target of so much unfair criticism. Of course they were wrong on many issues, but their attitude towards philosophy, knowledge and political action is unsurpassed.

What the logical positivist position on political action? Are you talking about things like getting evolution out of science classes, or are you talking about something else?

Comment author: Protagoras 03 April 2014 10:08:28PM 1 point [-]

The Logical Positivists were mostly pretty far left, but they mostly didn't engage in much political advocacy; though this was controversial among members of the movement (Neurath thought they should be more overtly political), most of them seemed to think that helping people think more clearly and make better use of science was a better way to encourage superior outcomes than advocating specific policies. They were also involved in various causes, though; many members of the Vienna Circle were involved in adult education efforts in Vienna, for example. The more I think about it, the more I think it's pretty accurate to say they had a lot in common with the Less Wrong crowd in their approach to politics (though they were almost certainly further left, even taking into account that the surveys suggest Less Wrong itself is further left than many people seem to realize).

Comment author: Stefan_Schubert 08 April 2014 08:37:55AM 3 points [-]

I'm talking primarily of their resistance to nazism, and how they saw intellectual and political strugges as inextricably intertwined. In this they were very similar to the French revolutionaries. See for instance this article where Carnap criticizes the nazi philosopher Heidegger in his usual meticulous and over-dry manner. Amazing that he managed to keep so cool in the face of such evil stupidity.

After the war, the US and Britain became the heart of analytic philosophy, and much of the seriousness of the Vienna Circle (and also Popper) disappeared. What replaced it was a rather frivolous, smart aleck kind of philosophy personified especially by people like Lewis and Kripke, but to some degree also Quine, Davidson, Austin and others.

In his excellent The Decline of the German Mandarins Fritz Ringer shows that the German academia grew increasingly dominated by mad romantic reactionaries from 1890 to 1933 (where the book ends). It seems to me (and I think, but am not sure, that Ringer touches upon this at some point) that this, however, spurred real thinkers, in the enlightenment tradition, to greater heights than they otherwise would have reached. They were forced to focus on the big questions, to come up with fundamental reasons for why you should adopt the rationalist perspective, because, unlike in the Anglo-Saxon world, this perspective had a terrifying opponent in the form of romantic reaction. Ringer mostly focuses on the great sociologist Max Weber and others like him, but I think that a similar can be told about the Vienna Circle (I don't recall whether he comments on them).

Comment author: Ixiel 14 April 2014 03:37:41PM 11 points [-]

If the best minds were in charge of designing a bridge, I would expect the bridge to hold up well even in a storm. If the best minds were in charge of designing an airplane, I would expect it to fly reliably. But if the best minds were in charge of something no one really knows how to do, I would be ready for a failure, albeit a failure with superb academic credentials.

Terry Coxon

Comment author: wadavis 15 April 2014 11:11:24PM 0 points [-]

All I'm getting out of this is that the quoted fails to understand the ability of great minds. Is there a context I'm missing?

Comment author: Ixiel 16 April 2014 11:53:35AM *  6 points [-]

Being ready for failure is not quite the same thing as considering success impossible.

The context is that economics is in shall we say an earlier stage of development than engineering, so we should be more conscious of the risk of economic tinkering failing than we need be of whether our bridge or plane falls apart underneath us.

Comment author: somnicule 09 April 2014 11:13:15AM 20 points [-]

“Even if it's not your fault, it's your responsibility.”

Comment author: Brillyant 15 April 2014 09:55:38PM 7 points [-]

This is a great tagline for the doctrine of Original Sin.

Comment author: DanArmak 19 April 2014 07:36:03PM 3 points [-]

"Even if it's not your fault, it's your punishment."

Comment author: Jayson_Virissimo 30 April 2014 10:59:34PM *  5 points [-]

I'm tired of coherent nonsense!

-- Tom Stoppard, The Real Thing

Comment author: Jayson_Virissimo 05 April 2014 06:50:49AM *  15 points [-]

...the utility of a thought experiment is inversely proportional to the size of its departure from reality.

-- Daniel Dennett, Intuition Pumps and Other Tools for Thinking

Comment author: johnlawrenceaspden 16 April 2014 12:02:42AM 6 points [-]

Are we sure about this? Einstein's idea of riding along with a light beam was super-useful and physically impossible in principle. Whereas the experiment I just thought of where I pour my cup of tea on my trousers I can almost not be bothered to do.

Comment author: Stabilizer 25 April 2014 09:56:38PM 2 points [-]

This is funny. Until I read your comment, I was misreading the original quote; I didn't notice the "inversely" part. I was implicitly thinking that the quote was claiming that the farther the thought experiment is from reality, the more useful it is. I guess my physicist biases are showing.

Comment author: johnlawrenceaspden 26 April 2014 12:22:07PM 3 points [-]

I think that's my point! It sounds just as profound without the 'inversely'.

Comment author: Vulture 16 April 2014 08:09:29PM *  7 points [-]

Ceteris paribus, then. On average, a thought experiment along the lines of "what if I poured this stuff on my trousers" is of much more practical use and tells you much more about reality than a thought experiment along the lines of "what if I could ride around on [intangible thing]". The most realistic thought experiments are the ones we do all the time, often without thinking, and which help us decide, for example, not to balance that cup of tea right on the edge of the table. Meanwhile, only very clever scientists and philosophers with lots of training can wring anything useful out of really far-out "what if I rode on a beam of light"-type thought experiments, and even they screw it up all the time and are generally well-advised not to base a conclusion solely on such a thought experiment. As I understand it, Einstein's successful use of gedankenexperiments to come up with good new ideas is generally considered evidence of his exceptional cleverness.

(note: I know very little about this topic and may be playing very fast and loose. I think the main idea is sensible, though)

Comment author: jaime2000 01 April 2014 02:24:24PM 15 points [-]

There is an important difference between “We don’t know all the answers yet” and “Do what feels right, man.” These questions have answers, because humans have biochemistry, and we should do our best to find them and live by the results.

~J. Stanton, "The Paleo Identity Crisis: What Is The Paleo Diet, Anyway?"

Comment author: ChristianKl 01 April 2014 09:16:28PM 3 points [-]

It not at all clear that someone who knows all the biochemistry will outperform someone who's good at feeling what goes on in his body.

In the absence of good measurement instruments feelings allow you to respond to specific situations much better than theoretical understanding.

Comment author: Lumifer 01 April 2014 03:01:43PM 6 points [-]

These questions have answers, because humans have biochemistry

But the answers might be specific to each individual because the biochemistry of humans is not exactly the same.

Comment author: dspeyer 15 December 2014 06:36:28PM 1 point [-]

In that case, the questions have complicated answers. The best dieting advice might be "first sequence your personal microbiome then consult this lookup table..."

Comment author: Eugine_Nier 02 April 2014 01:10:14AM 16 points [-]

I have long ceased to argue with people who prefer Thursday to Wednesday because it is Thursday.

G. K. Chesterton, attributed.

Comment author: Stabilizer 02 April 2014 01:13:37AM 5 points [-]

Upvoted. I would've preferred the following version:

I have long ceased to argue with people who prefer Thursday to Wednesday only because it is Thursday.

Comment author: johnlawrenceaspden 26 April 2014 10:16:30AM 6 points [-]

It has come to be accepted practice in introducing new physical quantities that they shall be regarded as defined by the series of measuring operations and calculations of which they are the result. Those who associate with the result a mental picture of some entity disporting itself in a metaphysical realm of existence do so at their own risk; physics can accept no responsibility for this embellishment.

Sir Arthur Eddington, 1939, The Philosophy of Physical Science

Comment author: Cyan 03 April 2014 05:59:38PM *  25 points [-]

It is, in fact, a very good rule to be especially suspicious of work that says what you want to hear, precisely because the will to believe is a natural human tendency that must be fought.

- Paul Krugman

Comment author: aarongertler 04 April 2014 05:55:35PM *  26 points [-]

"Throughout the day, Stargirl had been dropping money. She was the Johnny Appleseed of loose change: a penny here, a nickel there. Tossed to the sidewalk, laid on a shelf or bench. Even quarters.

"I hate change," she said. "It's so . . . jangly."

"Do you realize how much you must throw away in a year?" I said.

"Did you ever see a little kid's face when he spots a penny on a sidewalk?”

Jerry Spinelli, Stargirl

Comment author: aarongertler 04 April 2014 05:56:29PM 17 points [-]

So as to keep the quote on its own, my commentary:

This passage (read at around age 10) may have been my first exposure to an EA mindset, and I think that "things you don't value much anymore can still provide great utility for other people" is a powerful lesson in general.

Comment author: James_Miller 01 April 2014 10:57:23PM *  18 points [-]

“Anything outside yourself, this you can see and apply your logic to it." She said. "But it’s a human trait that when we encounter personal problems, those things most deeply personal are the most difficult to bring out for our logic to scan. We tend to flounder around, blaming everything but the actual, deep-seated thing that’s really chewing on us.”

Jessica speaking to Thufir Hawat in Frank Herbert's Dune

Comment author: roryokane 18 April 2014 01:26:11AM *  20 points [-]

“If only there were irrational people somewhere, insidiously believing stupid things, and it were necessary only to separate them from the rest of us and mock them. But the line dividing rationality and irrationality cuts through the mind of every human being. And who is willing to mock a piece of his own mind?”

(With apologies to Solzhenitsyn).

– Said Achmiz, in a comment on Slate Star Codex’s post “The Cowpox of Doubt”

Comment author: Nornagest 18 April 2014 04:41:16PM -2 points [-]

I'm not sure that's quite in the spirit of the thread rules, what with how closely tied Slate Star Codex is to the LW community. But it's a good enough abuse of Solzhenitsyn that I'm upvoting it anyway.

Comment author: Eugine_Nier 19 April 2014 04:01:32AM 3 points [-]

Am I the only one who finds it annoying how the "do not quote LW rule" has been creeping into ever broader interpretations?

Comment author: somnicule 19 April 2014 04:57:08AM 1 point [-]

Hmm. It's an interesting point.

I'm not entirely clear on the purpose of the rule. It makes sense to not just increase the redundancy of anything people have said in other threads that have already got a lot of attention, but I'm sure there's plenty of interesting stuff buried deep in comment threads that haven't got much light and might be worth sharing. Conversely, there will be some quotes here from outside LW/OB that a high proportion of readers have seen already.

So it's definitely something that made sense when the LW/OB community was smaller and there wasn't much good stuff that people weren't seeing anyway, but perhaps it's time to relax the rule a little bit, replace it with the substance.

Comment author: RichardKennaway 19 April 2014 08:10:58AM 4 points [-]

I believe the purpose was to bring material to LW from outside rather than quoting each other (and especially, quoting Eliezer), to avoid an echo chamber effect. There was once an experimental LW Quotes Thread, but the experiment has not been repeated.

I don't have a strong view about whether LW regulars posting on other LW regulars' blogs should be excluded from the quotes threads, but I incline against the practice. It was a good quote though.

Comment author: lmm 23 April 2014 11:00:34PM 1 point [-]

Which side do you incline against?

Comment author: Vaniver 18 April 2014 04:04:42PM 3 points [-]

The original quotation on LW.

Comment author: johnlawrenceaspden 05 April 2014 12:49:12AM 10 points [-]

I assume that the reader is familiar with the idea of extrasensory perception, and the meaning of the four items of it, viz., telepathy, clairvoyance, precognition and psychokinesis. These disturbing phenomena seem to deny all our usual scientific ideas. How we should like to discredit them! Unfortunately the statistical evidence, at least for telepathy, is overwhelming.

Alan Turing (from "Computing Machinery and Intelligence")

Comment author: gwern 02 May 2014 11:09:30PM 4 points [-]

Particularly relevant a quote given Yvain's recent http://slatestarcodex.com/2014/04/28/the-control-group-is-out-of-control/

Comment author: Jayson_Virissimo 04 April 2014 01:24:36AM 20 points [-]

Today is already the tomorrow which the bad economist yesterday urged us to ignore.

-- Henry Hazlitt, Economics in One Lesson

Comment author: johnlawrenceaspden 04 April 2014 11:28:43PM 0 points [-]

And it seems to be going pretty well!

Comment author: raisin 01 April 2014 03:45:37PM *  22 points [-]

Richard Feynmann claimed that he wasn't exceptionally intelligent, but that he focused all his energies on one thing. Of course he was exceptionally intelligent, but he makes a good point.

I think one way to improve your intelligence is to actually try to understand things in a very fundamental way. Rather than just accepting the kind of trite explanations that most people accept - for instance, that electricity is electrons moving along a wire - try to really find out and understand what is actually happening, and you'll begin to find that the world is very different from what you have been taught and you'll be able to make more intelligent observations about it.

http://www.reddit.com/r/askscience/comments/e3yjg/is_there_any_way_to_improve_intelligence_or_are/c153p8w

reddit user jjbcn on trying to improve your intelligence


If you're not a student of physics, The Feynman Lectures on Physics is probably really useful for this purpose. It's free for download!

http://www.feynmanlectures.caltech.edu/

It seems like the Feynman lectures were a bit like the Sequences for those Caltech students:

The intervening years might have glazed their memories with a euphoric tint, but about 80 percent recall Feynman's lectures as highlights of their college years. “It was like going to church.” The lectures were “a transformational experience,” “the experience of a lifetime, probably the most important thing I got from Caltech.” “I was a biology major but Feynman's lectures stand out as a high point in my undergraduate experience … though I must admit I couldn't do the homework at the time and I hardly turned any of it in.” “I was among the least promising of students in this course, and I never missed a lecture. … I remember and can still feel Feynman's joy of discovery. … His lectures had an … emotional impact that was probably lost in the printed Lectures.”

Comment author: JoshuaFox 17 April 2014 07:34:13AM 5 points [-]

that he focused all his energies on one thing

He brags shamelessly about his wide variety of interests: Drumming, lockpicking, PUA, biology, Tana Tuva, etc.

Comment author: waveman 14 May 2014 11:51:03AM 2 points [-]

The Feynman divorce:

...the appointee’s wife was granted a divorce from him because of appointee’s constantly working calculus problems in his head as soon as awake, while driving car, sitting in living room, and so forth, and that his one hobby was playing his African drums. His ex-wife reportedly testified that on several occasions when she unwittingly disturbed either his calculus or his drums he flew into a violent rage, during which time he attacked her, threw pieces of bric-a-brac about and smashed the furniture.

Comment author: raisin 17 April 2014 02:37:11PM 2 points [-]

You're right.

Comment author: arundelo 04 April 2014 02:13:10PM 24 points [-]

Specifically, [these recent books that deal with parallel universes] argue that if some scientific theory X has enough experimental support for us to take it seriously, then we must take seriously also all its predictions Y, even if these predictions are themselves untestable (involving parallel universes, for example).

As a warm-up example, let's consider Einstein's theory of General Relativity. It's widely considered a scientific theory worthy of taking seriously, because it has made countless correct predictions -- from the gravitational bending of light to the time dilation measured by our GPS phones. This means that we must also take seriously its prediction for what happens inside black holes, even though this is something we can never observe and report on in Scientific American. If someone doesn't like these black hole predictions, they can't simply opt out of them and dismiss them as unscientific: instead, they need to come up with a different mathematical theory that matches every single successful prediction that general relativity has made -- yet doesn't give the disagreeable black hole predictions.

-- Max Tegmark, Scientific American guest blog, 2014-02-04

Comment author: [deleted] 06 April 2014 01:54:26PM 5 points [-]

I would think the first objection to that line of reasoning would be that we know General Relativity is an incomplete theory of reality and expect to find something that supersedes it and gives better answers regarding black holes.

Comment author: Stabilizer 01 April 2014 08:10:10PM 24 points [-]

How much of a disaster is this? Well, it’s never a disaster to learn that a statement you wanted to go one way in fact goes the other way. It may be disappointing, but it’s much better to know the truth than to waste time chasing a fantasy. Also, there can be far more to it than that. The effect of discovering that your hopes are dashed is often that you readjust your hopes. If you had a subgoal that you now realize is unachievable, but you still believe that the main goal might be achievable, then your options have been narrowed down in a potentially useful way.

-Timothy Gowers, on finding out a method he’d hoped would work, in fact would not.

Comment author: Ixiel 04 April 2014 11:14:37AM *  35 points [-]

Slartibartfast: Perhaps I'm old and tired, but I think that the chances of finding out what's actually going on are so absurdly remote that the only thing to do is to say, "Hang the sense of it," and keep yourself busy. I'd much rather be happy than right any day.

Arthur Dent: And are you?

Slartibartfast: Well... no. That's where it all falls down, of course.

Douglas Adams, Hitchhiker's Guide to the Galaxy

Comment author: Benito 02 April 2014 06:15:24PM *  18 points [-]

“I propose we simply postpone the worrisome question of what really has a mind, about what the proper domain of the intentional stance is. Whatever the right answer to that question is—if it has a right answer—this will not jeopardize the plain fact that the intentional stance works remarkably well as a prediction method in these other areas, almost as well as it works in our daily lives as folk psychologists dealing with other people. This move of mine annoys and frustrates some philosophers, who want to blow the whistle and insist on properly settling the issue of what a mind, a belief, a desire is before taking another step. Define your terms, sir! No, I won’t. That would be premature. I want to explore first the power and the extent of application of this good trick, the intentional stance. Once we see what it is good for, and why, we can come back and ask ourselves if we still feel the need for formal, watertight definitions. My move is an instance of nibbling on a tough problem instead of trying to eat (and digest) the whole thing from the outset. “Many of the thinking tools I will be demonstrating are good at nibbling, at roughly locating a few “fixed” points that will help us see the general shape of the problem. In Elbow Room (1984a), o compared my method to the sculptor’s method of roughing out the form in a block of marble, approaching the final surfaces cautiously, modestly, working by successive approximation. Many philosophers apparently cannot work that way and have to secure (or so they think) the utterly fixed boundaries of their problems and possible solutions before they can venture any hypotheses.”

-Daniel Dennett, Intuition Pumps and Other Tools for Thinking, Chapter 18 "The Intentional Stance" [Bold is original]

Reminded me of the idea of 'hacking away at the edges'.

Comment author: shminux 03 April 2014 08:15:28PM 0 points [-]

Define your terms, sir! No, I won’t.

As far as I understand, he actually does define his terms. Dennett defines a mind as a rational agent/decision algorithm (subject to evolutionary baggage and bugs in the algorithm). Please correct me if I'm wrong.

Comment author: cousin_it 16 April 2014 10:22:07AM 21 points [-]

Being wrong about something feels exactly the same as being right about something.

-- many different people, most recently user chipaca on HN

Comment author: brazil84 19 April 2014 08:15:10PM 2 points [-]

Being wrong about something feels exactly the same as being right about something.

It occurs to me that "being wrong" can be divided into two subcategories -- before and after you start seeing evidence or arguments which undermine your position.

With practice, the feeling of being right and seeing confirming information can be distinguished from the feeling of being wrong and seeing undermining information. Unfortunately, the latter feeling is very uncomfortable and it is always tempting look for ways to lessen it.

Comment author: johnlawrenceaspden 17 April 2014 12:19:24AM *  3 points [-]

Hmm, what about such things as feeling that you need to defend the truth from criticism rather than find a way to explain it better? Or nagging doubts that you're ignoring, or a feeling that your opponents are acting the way they are because they're stupid or evil? Or wanting to censor someone else's speech? I take all these things as alarm signals.

A communist friend of mine once said, after I'd nailed her into a corner in a political argument about appropriate rates of pay during a fireman's strike, "Well under socialism there wouldn't be as many fires.". I reckon that there must be a feeling associated with that sort of thing.

Comment author: DanArmak 19 April 2014 07:21:58PM *  3 points [-]

Defending the truth from criticism also feels exactly the same as defending what you wrongly think is the truth from criticism.

The feelings you list correspond to very common ways people behave. So they're very weak evidence that you're wrong about something. Unless you're a trained rationalist who very rarely has these feelings / behaviors.

Most people first acquire a belief - whether by epistomologically legitimate ways or not - and then proceed to defend it, ignore contrary evidence and feel opponents to be stupid, because that's just the way most people deal with beliefs that are important to them.

Comment author: rule_and_line 16 April 2014 10:04:01PM *  3 points [-]

This is the most forceful version I've seen (assumed it had been posted before, discovered it probably hasn't, won't start a new thread since it's too similar):

But by definition, there can’t be any particular feeling associated with simply being wrong. Indeed, the whole reason it’s possible to be wrong is that, while it is happening, you are oblivious to it. When you are simply going about your business in a state you will later decide was delusional, you have no idea of it whatsoever. You are like the coyote in the Road Runner cartoons, after he has gone off the cliff but before he has looked down. Literally in his case and figuratively in yours, you are already in trouble when you feel like you’re still on solid ground. So I should revise myself: it does feel like something to be wrong. It feels like being right.

Kathryn Schulz, Being Wrong

But I'm not comfortable endorsing either of these quotes without a comment.

chipaca's quote (and friends) suggest to me that

  • my "being wrong" and "being right" are complementary hypotheses, and
  • my subjective feelings are not evidence either way.

Schulz's quote (and book) suggest to me that

  • my "being wrong" is broadly and overwhelmingly true (my map is not the territory), and
  • my subjective feeling of being right is in fact evidence that I am very wrong.

I'd prefer to emphasize that "You are already in trouble when you feel like you’re still on solid ground," or said another way:

Becoming less wrong feels different from the experience of going about my business in a state that I will later decide was delusional.

Comment author: gwern 02 May 2014 11:20:22PM 1 point [-]

Schulz hasn't been quoted here before, but you might've seen my use of that quote on http://www.gwern.net/Mistakes to which I will add a quote of Wittgenstein making the same quote but much more compressed and concisely:

One can mistrust one's own senses, but not one's own belief. If there were a verb meaning "to believe falsely", it would not have any [meaningful] first person, present indicative.

Comment author: dspeyer 04 April 2014 02:26:23AM 44 points [-]

"It is one thing for you to say, ‘Let the world burn.' It is another to say, ‘Let Molly burn.' The difference is all in the name."

-- Uriel, Ghost Story, Jim Butcher

Comment author: whales 02 April 2014 01:49:57AM *  23 points [-]

He said:

When you play bridge with beginners—when you try to help them out—you give them some general rules to go by. Then they follow the rule and something goes wrong. But if you'd had their hand you wouldn't have played the thing you told them to play, because you'd have seen all the reasons the rule did not apply.

from The Last Samurai by Helen DeWitt

Comment author: [deleted] 05 April 2014 05:45:29AM 36 points [-]

Philosophers often behave like little children who scribble some marks on a piece of paper at random and then ask the grown-up "What's that?"- It happened like this: the grown-up had drawn pictures for the child several times and said "this is a man," "this is a house," etc. And then the child makes some marks too and asks: what's this then?

  • Wittgenstein, Culture and Value
Comment author: Tyrrell_McAllister 02 April 2014 05:53:47PM *  46 points [-]

The mathematician and Fields medalist Vladimir Voevodsky on using automated proof assistants in mathematics:

[Following the discovery of some errors in his earlier work:] I think it was at this moment that I largely stopped doing what is called “curiosity driven research” and started to think seriously about the future.

[...]

A technical argument by a trusted author, which is hard to check and looks similar to arguments known to be correct, is hardly ever checked in detail.

[...]

It soon became clear that the only real long-term solution to the problems that I encountered is to start using computers in the verification of mathematical reasoning.

[...]

Among mathematicians computer proof verification was almost a forbidden subject. A conversation started about the need for computer proof assistants would invariably drift to the Goedel Incompleteness Theorem (which has nothing to do with the actual problem) or to one or two cases of verification of already existing proofs, which were used only to demonstrate how impractical the whole idea was.

[...]

I now do my mathematics with a proof assistant and do not have to worry all the time about mistakes in my arguments or about how to convince others that my arguments are correct.

From a March 26, 2014 talk. Slides available here.

Comment author: DanielLC 04 April 2014 03:04:51AM 2 points [-]

I know you're not supposed to quote yourself, but I came up with a cool saying about this a while back and I just want to share it.

Computer proof verification is like taking off and nuking the whole site from orbit: it's the only way to be sure.

Comment author: RichardKennaway 30 April 2014 11:30:38AM 5 points [-]

Imagine, then, that a man should need to get fire from a neighbour, and, upon finding a big bright fire there, should stay there continually warming himself; just so it is if a man comes to another to share the benefit of a discourse, and does not think it necessary to kindle from it some illumination for himself and some thinking of his own, but, delighting in the discourse, sits enchanted; he gets, as it were, a bright and ruddy glow in the form of opinion imparted to him by what is said, but the mouldiness and darkness of his inner mind he has not dissipated nor banished by the warm glow of philosophy.

Plutarch, "De Auditu" (On Listening), a chapter of his Moralia.

This essay is also the original source of the much-quoted line "The mind is not a pot to be filled, but a fire to be ignited." It is variously attributed, but is a fair distillation of the original passage, which comes directly before the quote above:

For the mind does not require filling like a bottle, but rather, like wood, it only requires kindling to create in it an impulse to think independently and an ardent desire for the truth.

Comment author: Dagon 17 April 2014 03:39:25PM 12 points [-]

But understanding human limitations does not mean we can overcome them. It only means we can’t pretend they don’t exist. It should point us toward humility, not hubris.

Yuval Levin in the National Review

Comment author: DanArmak 19 April 2014 07:13:12PM 1 point [-]

To the extent that we can overcome our current limits, we have to understand them first. We should beware false humility and rationalization of existing limits (e.g. deathism).

Comment author: johnlawrenceaspden 15 April 2014 11:43:31PM 14 points [-]

Encoded in the large, highly evolved sensory and motor portions of the human brain is a billion years of experience about the nature of the world and how to survive in it. The deliberate process we call reasoning is, I believe, the thinnest veneer of human thought, effective only because it is supported by this much older and much more powerful, though usually unconscious, sensorimotor knowledge. We are all prodigious olympians in perceptual and motor areas, so good that we make the difficult look easy. Abstract thought, though, is a new trick, perhaps less than 100 thousand years old. We have not yet mastered it. It is not all that intrinsically difficult; it just seems so when we do it.

Hans Moravec, Wikipedia/Moravec's Paradox

Comment author: johnlawrenceaspden 15 April 2014 11:44:57PM 10 points [-]

The main lesson of thirty-five years of AI research is that the hard problems are easy and the easy problems are hard. The mental abilities of a four-year-old that we take for granted – recognizing a face, lifting a pencil, walking across a room, answering a question – in fact solve some of the hardest engineering problems ever conceived... As the new generation of intelligent devices appears, it will be the stock analysts and petrochemical engineers and parole board members who are in danger of being replaced by machines. The gardeners, receptionists, and cooks are secure in their jobs for decades to come.

Stephen Pinker, Wikipedia/Moravec's Paradox

Comment author: roystgnr 02 May 2014 03:24:14PM 2 points [-]

What was the ratio of phone time spent talking to human vs computer receptionists when Pinker published this quote in 2007? For that matter, how much non-phone time was being spent using a website to perform a transaction that would have previously required interaction with a human receptionist?

Pinker understood AI correctly (it's still way too hard to handle arbitrary interactions with customers), yet he failed to predict the present, much less the future, because he misunderstood the economics. Most interactions with customers are very non-arbitrary. If 10% need human intervention, then you put a human in the loop after the other 90% have been taken care of by much-cheaper software.

If you were to say "a machine can't do everything a horse can do", you'd be right, even today, but that isn't a refutation of the effect of automation on the economic prospects of equine labor.

Comment author: More_Right 26 April 2014 09:35:22AM 1 point [-]

The gardeners, receptionists, and cooks are secure in their jobs for decades to come.

Except that in exponentially-increasing computation-technology-driven timelines, decades are compressed into minutes after the knee of the exponential. The extra time a good cook has, isn't long.

Let's hope that we're not still paying rent then, or we might find ourselves homeless.

Comment author: wadavis 15 April 2014 11:08:26PM *  8 points [-]

'There is of course the question of public safety,' said Vetinari. 'Did I hear you say earlier you have blown up... "one or three" I think was the phrase?"

'I made those explode a-purpose, to see exactly how it 'appened. That's the way to get knowledge, you see, sir.'

Raising Steam, Terry Pratchett

Regarding the first steam engine in Pratchett's fictional world.

Comment author: gwern 02 May 2014 11:15:06PM 1 point [-]