Rationality quotes: October 2010
This is our monthly thread for collecting these little gems and pearls of wisdom, rationality-related quotes you've seen recently, or had stored in your quotesfile for ages, and which might be handy to link to in one of our discussions.
- Please post all quotes separately, so that they can be voted up/down separately. (If they are strongly related, reply to your own comments. If strongly ordered, then go ahead and post them together.)
- Do not quote yourself.
- Do not quote comments/posts on LW/OB.
- No more than 5 quotes per person per monthly thread, please.
Loading…
Subscribe to RSS Feed
= f037147d6e6c911a85753b9abdedda8d)
Comments (472)
-- Proceedings of the 1968 NATO Conference on Software Engineering
William T. Powers
I don't understand the first sentence.
Proposition 1: All matter is composed of four elements: earth, water, air, and, fire, each having an unchanging essence, and the variety of the world resulting from their combinations.
Proposition 2: All matter is composed of about 90 elements (the cutoff depending on how many of the more unstable ones one counts), most of which are created out of hydrogen and helium in stars and their supernovas, and which, in combination, give rise to the different material substances we observe.
More abstract proposition that ignores the differences: all matter is composed of fundamental elements.
Erroneous conclusion: the ancients knew modern science!
Proposition 1: Six thousand years ago, God created the world in six days.
Proposition 2: Everything started with the Big Bang some billions of years ago.
Abstract proposition: The universe had a beginning.
Erroneous conclusion: God created the universe. Scientists just call it the Big Bang because they don't want to admit it was God.
ETA: Further example: anyone saying that all religions are fundamentally the same.
ETA: Proposition 1: Here is a hammer. It drives nails.
Proposition 2: Here is a screwdriver. It drives screws.
Abstract proposition: Here is a tool. It drives spiky metal fasteners.
Erroneous conclusion: A Manchester screwdriver.
Your explanation was way better than your quote.
Thanks! I get it now.
Voted up, because I don't understand that sentence either. Could someone explain it, with an example if possible?
http://www.google.com/search?q=reference%20class%20tennis%20site%3Alesswrong.com
Reference class tennis.
Rene Descartes.
Ha! That's very clever and nicely phrased. (And true, sadly.)
Serion Ironcroft
That philosophy is not Psyclobin Complete. :)
No philosophy survives sticking a crowbar into your own brain.
I don't know - Philip K. Dick seemed to do all right. And I heard of at least one schizophrenic who tried to record the voices in her head on a tape and figured out they weren't real that way.
Hmm... The complaint was that Psyclobin (for example, amongst other everyday occurrences) causes one to see things that you should not believe in. I'm not sure where the analogy holds with a crowbar, or else what point you were trying to make.
The philosophy does not survive in the sense that it is instantiated in ones brain and the brain has been destroyed. But the crowbar experiment does not thus show that the beliefs thus destroyed are false.
The crowbar was a metaphor for psilocybin and the like.
I mean, yes, you can have hallucinations that you take for real and are mistaken to believe. But, y'know, there is such a thing as healthy mental functioning, and a real world that we are able to grope towards some fallible understanding of. There's a baseline of rationality that you have to have reached in order to progress to any higher level, but it isn't very high: anyone who hasn't suffered grievous insults to the brain is already there.
Anyway, it's interesting to see this quote at -2, while the George Carlin quote is at +2 although it says the same thing. Surely on LessWrong people aren't merely voting up witty words, and nitpicking anything expressed more plainly?
Your quote seems to state, "Believe everything you see", on a site where people would often agree "Don't believe everything you think". Carlin does not seem to be making the same sort of claim.
Shouldn't you believe you see everything you see?
If you want to then make wild inferences like 'there is an imperceptible separate "matter" or "object" which "causes" these sights on past and future occasions and which continues to exist between them unobserved, and every sight has a corresponding "matter" or "object"', well, that's not Ironcroft's problem.
On the same theme as the previous one:
George Carlin
Either the prayer is answered, or not, so the odds must be 50%, right? :)
From this I infer that Carlin errs somewhat on the side of pessimism. Optimal habits of thought will tend to produce the kind of positive attention and focus that prompts prayer in cases that are actually less than 50% likely to occur.
"[H]e who commands thirty legions is the most learned of all"
Favorinus explaining why he admitted that Emperor Hadrian had won their debate.
"Won't you stop citing laws to us who have our swords by our sides?" Pompey
The value of the first quote to a rationalist comes from understanding that the sentiment behind it has distorted the words of many writers. Favorinus probably believed that Hadrian would not have punished him had he not stated that he lost the debate.
The second quote explains why even in the United States you shouldn't argue over law with a police officer who is questioning you in a situation in which non-police officers are not observing you.
Pompey probably wasn't threatening but rather was pointing out stupidity.
Even here, this quote should not be presented with commentary. Some of the greatest tragedies of human history happened because people who commanded thirty legions through luck, birth, or narrow political talents believed that they were the most learned of all and insisted that others act accordingly.
Might does not make right (justice); still less does it make right (wisdom/truth).
I suspect Plutarch stole the second quote from Cicero (Silent enim leges inter arma, "for among weapons laws fall silent") before shoving it in Pompey's mouth.
William T. Powers
I'd be concerned that this phrasing would raise more sociopaths... because that's how they think about morality.
The idea of teaching relativism for moral specifics is good, but consider that there are aspects of morality common to all sustainable cultures. Powers' framing would describe these as "common game elements" or "aspects common to all these different games". I think they should be emphasized/emotionalized as a little more than that (even if they aren't), so to avoid sociopathy (if that's even possible).
Less specifically, and with more confidence: emotional intelligence is a thing, and children need to be taught that, too. Perhaps Powers could achieve this by teaching kids that "feeling good about doing good things" is part of the game, and maybe one of the objectives of the game.
Sociopaths and mature adults share that conception. Both of these groups of people tend to have also discovered that it is usually not in their best interest to discuss the subject with people who do not share their maturity or sociopathic nature respectively.
The reason a sociopath must arrive at the insight Powers proposes we teach earlier is that they cannot survive without it. Where a normal individual can survive (but not thrive) with a naive morality a sociopath cannot rely on the training wheels of guilt or shame to protect them from the most vicious players in the game before they work things out.
I predict that Powers' curriculum would produce no more sociopaths, make those sociopaths that are inevitable do less damage and result in a whole heap less burnt out, anti-social (or no longer pro-social) idealists.
You're awesome. Specifically, you communicate useful insights often. I tend to agree with you, but when I don't, I'm glad to have read you.
Making incompetent sociopaths more rational would create new harms as well. They would be better able to fool people and would erode the trustworthiness of "normal-seeming people" a little. But since there are already many competent sociopaths, and because normal people are situationally also selfishly destructive (self-serving bias+hypocrisy), we have institutions that mitigate those harms.
Also, I agree that preventing damaged people from running amok (in the extreme killing N people and then themselves) would be fantastic.
That sounds right to me. I suspect the main difference that improving social education for all children would have on sociopaths is that it would knock some of the rough edges off the less intelligent among them. The kind of behaviours that are maladaptive even for sociopaths and may lead them to do overtly anti-social things and wind up sanctioned.
The models I have for competent sociopaths and high status individuals are approximately identical for basically this reason.
The quote doesn't talk about morality. I take it to be about social rules such as what is considered proper dress, table manners, rudeness and politeness, playing nicely, and so on. At a certain age (as WTP alludes to) children become capable of understanding above that level, and they will need a proper upbringing in what is good and real at that level as well. There's another quote of WTP I could give in this connection, but I've used up my quote quota for this month.
If you share it in a multiply nested reply to another comment then it is not included in the 'quote quota' - it's just the same as including a quote in any other conversation.
(ie. Your interpretation about applying to social rules rather than morality and ethics themselves seems right and I am interested in hearing the quote you have in mind.)
Ok then:
-- William T. Powers
I like the first paragraph in particular.
Game players usually evolve some sense of honour which avoids them breaking the rules, and although they know the rules are arbitrary, they aren't willing to change them at any moment. If more frequent breaking of the rules is what you fear.
The analogy I use in my head instead of games is languages. They both have rules, but "games" implies something fake, not productive, and not to be taken seriously. "Languages" are tools we're accustomed to using for everyday functional reasons, and it's clearer that breaking their rules arbitrarily has a more immediate detrimental effect on their purpose (communication).
The most common way I use the metaphor explicitly is during a misunderstanding with a friend. "Wait--what does X mean in Sammish? Z? Ohh, now I get it. In Relsquish, X means Y. That's why I thought you were talking about Y."
The nice thing about this model is that, in a game, you expect everyone to know the rules before you sit down to play. If someone doesn't follow them, they're either too ignorant to play or cheating. When you're talking to someone who speaks a different language from you (even if they're just different versions of English, like Sammish and Relsquish are), occasional confusion is a matter of course. When you misunderstand each other, no one has "broken" the rules; it's just a mismatch. You identify that, explain in other words, and move on, with much fewer hard feelings or blame.
That is very fun to say. Rel-squish!
Haha. Yes, it is. I don't get to say it much, because I'm Fizz to almost everybody who knows me in person--so I refer to myself as speaking Fizzish instead. I didn't think it was worth the trouble of explaining that for the sake of the example, though. :)
I think that this quote misses an important point - and am in agreement with Academician.
Although the particular social etiquette habits of different cultures vary widely, many of them serve similar, underlying purposes.
Kurt Vonnegut makes my case beautifully, and as gently as always in 'Cat's Cradle'. Without going into the plot, there is a 'holy man' (actually, a rationalist in an impossible situation, IMHO); followers of this holy man, when they meet each other, undertake a ritual called "the meeting of souls" (or similar) :- they remove their shoes and socks, and sit down, legs extended, foot to foot.
Abstract: Ritual forms of social etiquette are human and beneficial (if not essential): the form that they take is non-essential.
There is a higher order of information in this than in the assumption that all rituals are simply arbitrary game-playing.
I wish my mother had used this strategy, instead of the completely arbitrary-sounding "this is just the way you are to do things" which just caused a counter-reaction.
Grownups have already learned the reason to follow the rules: it's what society expects, so your life will be easier and you will be able to accomplish more if you follow them. But for the most part they learned it by osmosis, intuition, and implication--as you presumably did when you grew up--because nobody made it explicit to them, either. I think that most people don't explain this to their kids because they don't understand it themselves; they've never verbalized the reason, so they're just passing on the social pressure which worked for them.
The sad thing about this is not only that it leads to parroting "courtesy" without real understanding. It's that without being able to articulate the purpose of the social contract in general, one can't evaluate the reasons for specific clauses within it. When they seem arbitrary, they're difficult to remember, and even more difficult to respect. Consciously examining the structure allows you to see patterns in it (e.g. if X is rude, putting someone in a position where they must do X is also rude), as well as compare their implied goals against your actual goals.
For example, there are a few situations where I consider a clear understanding of the situation more important than courtesy, and will press someone to explain something which would otherwise be rude to ask for. But, unless they already know me well not to need it, I'll also explain what I'm doing and why, so they know it's not simply out of disregard. Like many things (grammar, musical composition), you have to understand the rules well before you can break them intelligently. It's a lot more acceptable to violate the social contract if you understand why the part you're violating exists and have made a conscious choice not to follow it.
I suspect that, for that reason, real understanding of society and its rules would make social change easier and bring the rules themselves more in line with peoples' actual goals. The key word there is "real," though. Just a little knowledge is a dangerous thing.
Paul K. Feyerabend [The final chapter of Against Method, 1975]
The virtue which is nameless?
Actually, no. In the rest of "Against Method" it's pretty obvious that Feyerabend is saying is that since even our methodologies and standards of evidence are paradigm-dependent, none of them really allow us to objectively connect with reality. As a result, epistemology and science are "anything goes"; any standard of evidence is acceptable no matter what it is. So he's closer to a relativist than a rationalist.
(Edited for clarity)
Dexter's Laboratory
Found at The Healthy Skeptic.
Cited here as appearing in Reaven GM, "Effect of dietary carbohydrate on the metabolism of patients with non-insulin dependent diabetes mellitus." Nutr Rev 1986 , 44(2):65-73.
-- tocomment, in a Hacker News post
Brilliant. And if they did make it into a tshirt (as per reply) I'd quite possibly buy one!
(I is going to get started on setting up the Less Wrong store with User:Kevin starting in a week or two, after which we'll be able to sell awesome LW-related shirts like this.)
Good, I was afraid I was the only one who'd started calling him "User:Kevin" after seeing Clippy do it.
By the way, I will definitely design an "Escape your closing parenthesis." t-shirt.
Must repost:
Where will proceeds go?
Not sure yet... I think the largest functionality will be selling rationality-related books and the like, pre-vetted by rationalists, with reviews, and all in one place. I'm not sure if we can get bulk pricing, and there's not much incentive to buy books from the LW store if you can get the same from Amazon. What I wanted to do was set up a checkout system where you can choose your price beyond a certain minimum, where proceeds will go to your choice of one of a few rationality-related charities listed (potential candidates being FHI, SIAI, Richard Dawkins Foundation, et cetera).
At some point I'm going to dig through my old files and find my original proposal, then modify it and post it in the discussion section here at LW. I'll ask for proposals and request ideas/critiques. That'll probably be in a week to three from now.
Did you consider just using Amazon Affiliates? If I recall one of the options would just allow you to set up a completely independent website, send the orders through them and take a cut. Charging more is also possible. Obviously you don't get anywhere near as much money as if you did it all yourself but you would need to be passing a LOT of inventory to make that hassle worthwhile. And if you do end up making large numbers of sales then you can transition to handling the orders yourself if it happens to be worth it.
Huh, Affiliates seems to have changed since I checked it out a few months ago, or maybe I misunderstood it back then. Thanks for the tip.
From memory there are actually a variety of different options. Ranging from 'link to us and get a cut if your readers convert to sales' through 'they will not even know Amazon is involved' and even the option of actually owning your own stock and using Amazon to handle storing and distribution. (None of this is as cheap as making some business connections and private arrangements. But it's a heck of a lot easier!)
I have no actual information on how well that will work (it seems like it would), but that phrase triggered a memory for me of an xkcdsucks post:
I'll try to ignore that bias and evaluate the store neutrally when it's up. This post may be noise.
This is a bit tangential to your point...
That may well not be true. I doubt that there's an easy route to send small amounts of money to most bands (unlike charities). Here is a tech-savvy author turning away tips from readers, out of fear that they're pirating his books. And he does have free books that might elicit a tip.
Appropriate, since it's about as wise as the average T-shirt slogan.
On the other hand some t-shirts are a source of true wisdom! ;)
This sounds like a bad idea.
It does, but mostly for the same reasons that cryonics does. It's a violation of Common Sense and Sensibility. But given the beliefs that tocomment has (emphasis: not mine!) it is the wise decision for him to make. He has just bitten the bullet and actually followed through from his stated beliefs with (token verbal support of) the rational conclusion.
I think tocomment has his predictions about the future miscallibrated and has probably not accounted for his own cognitive failure modes but I suspect that people would judge him to be 'unwise' almost completely independently of whether or not they share his premised beliefs.
Basically, I think we (that is, humans) are likely to judge him as naive and foolish because he is actually acting as though his beliefs should relate to his pragmatic choices.
By way of some illustration:
You know, that actually sums up my concerns regarding saving.
I think that: Within the next 30 years, a singularity and major economic upheaval are each much more likely than any kind of "business as usual" situation for which IRAs were intended. I also think that money (at least USD) will be of much less value to me when I'm 60.
And yet I contribute anyway, and only have about 8% of current USD value of my savings invested in a way appropriate for one of those scenarios.
Now, I've gotten a bit better: I stopped maxing out the 401k (i.e. putting 25% of pre-tax earnings in it), and I'm keeping a car loan I could pay off. But if I were really serious about this, I should empty most of the account, and put it in something else, even though this will incur a big penalty.
Wow. I was the one that initiated this line of reasoning and even so I took a double take at seeing that
Elaborate.
I'm just noting that while it makes sense in context I don't usually expect to see "Now, I've gotten a bit better ... I'm keeping a car loan I could pay off." The irony appeals.
LOL good point. 99.999% of personal finance discussions, it's supposed to work out the opposite.
Hm, how about...
Beliefs are justified by their Solomonoff-nature. That is the core of Bayesianism. Science is bookkeeping.
It bothers me that "bookkeeping" is given a disparaging tone.
Perhaps because it is easy to ritualize bookkeeping? I think to remember that is to keep within the spirit of the twelfth virtue, the void.
I've never met an accountant I didn't like. The nice thing about bookkeeping is that you have to make your sums come out right.
Nor have I. (But I haven't met enough accountants for this to mean much either way.)
I also thoroughly approve of all kinds of bookkeeping, related to science or otherwise. In particular I praise anyone else who takes care of it (so that I don't have to!)
That's because it's easy to misvalue assets if you're disconnected from the production process. So when you have specialized bookkeepers, others will typcially see them as ignorant of the true value of the assets, and associate this with bookkeeping per se, rather than bookkeeping with a screwy incentive structure and/or knowledge flows. Because this is the context in which most people interface with accountants, they tend to be associated with misvaluing assets. And thus:
"Beancounters didn't think a soldier's life was worth 300 [thousand dollars]." -- Batman Begins
Edit: Sorry, I forgot to translate all that: P(observe "accountant" | believe accountant misvalued assets) > P(observe "accountant" | ~believe accountant misvalued assets)
This is very insightful. Upvoted.
...
...
...reason #7 I love LessWrong: when they want to improve audience comprehension, people have to translate from English to mathematical formulas instead of the reverse.
If I could just recruit another equally capabler soldier for $ 299,000 or less with no ill consequences, then this seems like a shut up and multiply situation that accountants are trained for.
Hell, from a utilitarian perspective, if I saved a single soldier with that money instead of feeding and housing let's say, 300 African children for 10 years, then I made a stupid decision.
I think the accountant got things just about right.
Good point, bad example -- that's probably a case where accountants have the best knowledge of the costs of losing a soldier, and the generals are best capable of communicating it. The military also provides a certain payout to the family for a death.
Still, I find it hard to believe that there aren't some US soldiers for which it's worth spending 300k for the level of protection that a high-tech kevlar bodysuit provides. Special Forces goes to pretty insane lengths to provide protection, although perhaps the $300k unit cost would only be with a bulk discount, etc.
(Of course, it's fictional evidence anyway...)
Usually military personnel who have received expensive enough training to justify that are called officers, but there are definitely some exceptions. I wouldn't disagree.
And, now that you mention it, I could imagine the pay out being expensive enough that not paying the money would flatly irrational, but I don't know the number.
I don't either, but the most it could save would be the soldier's life value times the current risk of death (i.e. assume the bodysuit prevents all deaths), not the full life value. And, although Lucius Fox is potrayed as a smart man, the context makes it seem like he was comparing $300k to the cost of a life, without adjusting for the chance that it would actually save the life.
That isn't a counterargument. "Officer" is a (category of) rank, not a job description. A whole lot of actual military "action" work is in fact performed by officers, particularly if it involves high levels of skill. (For example, pilots are usually officers.)
Yes, they are. But I've never heard a pilot called a soldier. This goes for most jobs performed by people in the O Ranks.
I am using Soldier to be interchangeable with Enlisted Man since I've seen and heard it used that way myself.
I assumed it was used that way in context, but maybe it wasn't.
No, "soldier", at least in U.S. military jargon, means "member of the Army" (as opposed to the other services). The Army chief-of-staff, a four-star general, will refer to themselves as a "soldier".
I see it as disparaging because I regard it as something a computer ought to be doing. If a human is doing bookkeeping and they aren't doing it for a reason like 'to practice' or 'to understand better', then something is very wrong.
Just because something is a job for computers does not mean that it's not a critical job.
Maintaining a nuclear core at a constant temperature is a very critical job, but I would regard as a dystopia any world where all cores are so maintained by a human and not a microcontroller.
We are in agreement on that. My point is that the quote "everything else [in scientific rigor] is bookkeeping" conveys the idea that it's not important, not that it isn't a human's job.
"Testing" needs to be replaced with a new term if you are moving to that level.
Changed to 'justified' 'cuz that's the first thing that came to mind...
That works. I was tossing up "evaluated" or "weighed" but nothing sprung to mind that was a clear winner.
"Everything has been said, yet few have taken notice of it. Since all our knowledge is essentially banal, it can only be of value to minds that are not"
Raoul Vaneigem
I'm having an extremely hard time understanding this quote. Its premises seem to contradict themselves.
How can a mind be original (not banal) if everything has been said and all knowledge is banal?
Only the set of beliefs that are actually routinely expressed can be considered banal; no matter if someone else has already said something, if it occurs to me organically, then it's probably useful.
Perhaps data is banal and code may be either banal or non-banal.
Yes, that would be necessary for the quote to make sense. However, I call a mind banal to the extent that its output is.
When evaluating the outputs of an algorithm, we have to consider the interestingness of the outputs under various counterfactuals. Otherwise, all game-theoretic agents are equivalent to either Cooperation Rock or Defection Rock, and all probabilities are either 0 or 1. And once you're specifying outputs as a complete truth-table, you're effectively specifying the algorithm.
To give a concrete example, I consider the server running lesswrong.com to be a banal mind, because it performs little computation of interest itself, even though when messages are sent from it to my computer those messages often contain very interesting ideas.
I see your point. I was presuming a human mind w/ the typical range of experiences available to it.
-- Bertrand Russell
(Quoted, in Italian translation, on p. 174 of Amanda Knox's appeal brief.)
Why does something called a "brief" have 174-plus pages?
Ha -- you'd have to ask a member of the legal profession. (No doubt you could think of a few other questions while you were at it.)
In fairness, however, the document is actually called an atto di appello (literally "act of appeal"). I probably should have just translated it as "appeal document" rather than trying to show off my cursory familiarity with (anglophone) legal terminology.
[Dictionary.com]
As a member of the legal profession, all I have to add is that "summary of the facts of the case" isn't quite right; better would be "summary of the law that applies to the facts of the case." The term passed from ecclesiastical law to civil law because the applicable civil law is an authority on what a judge should do in much the same way that a papal proclamation was thought of as an authority on what Catholics should do.
Interesting; thanks.
In the Italian system, as I understand it, the first level of appeal remains concerned with the facts of the case, in addition to the applicable law -- so "summary of the facts of the case" would actually be more appropriate than usual here. (Although the most informative description is probably just "critique of the lower court's ruling".)
I just got the urge to paraphrase Duke Leto Atreides: "A rationalist lawyer would be formidable indeed."
Flattery will get you everywhere.
-- adapted from Reinhold Niebuhr
Is this a piece of traditional deep wisdom that's actually wise?
I think the local version would be something like, "May my strength as a rationalist give me the ability to discern what I can and cannot change, and the determination to make a desperate effort at the latter when remaining uncertainty allows that this has the highest expected utility."
That was beautiful. :)
What I like about the serenity prayer (at least the way I interpret it) is that it puts the priority on changing things; serenity is just a second-best option for things that are unchangeable.
In that respect, it's like a transhumanist slogan. With something like life extension, I want to point to the serenity prayer and say we can change this, which means we need to have the courage to change. Death at the end of the current lifespan isn't something that we should serenely accept because we can change it. The serenity prayer calls for courage and action to follow through and make those changes.
Part of the difficulty is that the wisdom to know the difference also requires the wisdom to change your mind. Once people accept that something cannot be changed, then their serenity-producing mechanisms prevent them from reconsidering the evidence and recognizing that maybe it really can (and should) be changed.
If I was going to alter the serenity prayer, that's one thing I'd add. In Alicorn's version, that means the strength as a rationalist to distinguish what I can and cannot change, and to update those categorizations as new evidence arises.
Friends, help me build the serenity to accept the things I cannot change; the courage to change the things I can; and the wisdom to continually update which is which based on the best available evidence.
I think it genuinely wise, it contains three related important concepts: 1) You should try to make the world a better place, 2) You shouldn't waste your effort in attempting 1 in situations when you will almost certainly fail, 3) in order to succeed at 1 & 2 you need to be able to understand the world around you, a desire, to affect change isn't enough.
The only thing that's missing form it is something about having the insight to distinguish good changes form bad ones.
Except for the God grant me part, yeah.
Er, how about the wisdom to know whether a thing should be changed in the 1st place?
God grant me the strength to change the things I can,
The intelligence to know what I can change,
And the rationality to realize that God isn't the key figure here.
Cute, but you just undermined "strength" :)
I think Mike Vassar said something like "you should not have preferences over the current states of the world, only over your emotional dispositions". It's a second-hand quote, but seems like a good way of putting it.
I didn't expect much karma for this, but WTF with the downvote?
Because the quote seems to be endorsing wireheading, which is pretty universally condemned here, and seems of little relevance anyway.
+(-1)
Did Vassar really say something like that? I didn't think he was, well, silly.
If capitalism is the evolutionary engine that leads to AI, then the advent AI cannot be separated from the larger economic consequences of AI. In my judgment, the single most realistic way to design God-AI that is friendly is to evolve such AI directly out the economy that succeeds human capitalism, i.e. as an economic servant to human needs. While this is not a guarantee of friendly AI in itself, any attempt to make AI friendly purely on the basis of absolute, unchanging principles is doomed to ultimate failure because this is exactly how human intelligence, at its best, does not work.
Mitchell Heisman, Suicide Note p315
I looked at that site. The guy writes like a crackpot.
Seconding CronoDAS, that's an awful book, but I found one funny sentence in it:
The problem is that understanding the economy is probably harder than understanding human intelligence. After all, the global economy is the product of over 6 billion human brains interacting with each other and their environment.
What does 'understanding the economy' mean? Routinely economists point out missed opportunities which the market then exploits (IIRC one of the standard examples was a paper which discovered a small average rise on Mondays), or simple models outperform the economists' predictions of the future.
By "understand", I mean have a sufficiently good model to make high quality predictions about what key economic variables are going to do. And I wouldn't call papers like the one on the Monday effect routine, though they do happen.
(R. Diekstra, Haarlemmer Dagblad, 1993, cited by L. Derks & J. Hollander, Essenties van NLP (Utrecht: Servire, 1996), p. 58)
I think of this as a rationalist parable and not so much a quote. It has a lot of personal resonance since I often had dog biscuits with my tea when I was younger.
Speaking of Korzybski, does anybody have a concise summary of his ideas? Maybe some introductory material? I looked over the wikipedia article on General Semantics, and I'm still not entirely sure what it's talking about.
Extremely short version: it's a load of crap
Slightly longer version: He taught that you should never refer to things in general terms or else you'll confuse the map for the territory. For example, the chair I'm sitting in now is chair^1, the identical chair across the table is chair^2, there's chair^1 as I'm eperiencing it now, chair^1 as I experienced it last night, and so forth. Oh and you should try to avoid the use of the copula "to be" because it encourages sloppy thinking (i'm not sure how, just paraphrasing what I remember)
You didn't make it sound like a load of crap: it reminds me of the idea of using Lojban, or even better a formal logic system, for everyday speech. Impractical, but it would avoid a ton of misunderstanding, or spilled blood for that matter.
I'm a big fan of Lojban in principle, even more so after studying it in depth for a paper I'm writing, but I just don't think it's possible to significantly affect thought through language.
That's why General Semantics is a load of crap to me - being anal retentive with language is just going to annoy the heck out of everyone involved, and nothing else. There's a good reason why natural language is so vague.
I was about to upvote this but then I realised I wasn't in the right thread for that!
I couldn't disagree more strongly. Our thoughts are fundamentally affected by which concepts are easiest to express given our language primitives. You can control how people think simply by altering which concepts are permitted as base level representations even if everything is permitted as a construct thereof.
In the same way people will think differently when they are writing in C than when they are writing in LISP even though technically everything that can be done in one can be done in the other (or in Brainfuck or Conways Life for that matter).
Really? A claim like this needs some evidence. George Orwell novels don't count.
I recommend Steven Pinker's The Language Instinct, which clarifies to what extent language can influence thought.
I never read it. I understand there were pigs involved.
I liked Pinker when I read other stuff of his but I haven't got to that book yet.. Now, back to thinking about good modularity and DRY while writing OISC machine code.
(In case my meaning was not clear, let me be explicit. You made the response "A claim like this needs some evidence" to a comment that actually referred to evidence. Even if you think there is other, stronger, evidence that contradicts what we can infer from observing the influence of language on programmers it is still poor conversational form to reply with "needs non-Orwell evidence".)
I apologize for poor conversational form.
Let me try again, hopefully more nicely: You made a very strong claim with very weak evidence.
You claimed our thoughts were fundamentally affected by our language, and that someone can control how people think by tweaking the language. Your evidence was your own sense (not a paper, not even a survey) that people think differently when writing in a different programming language.
If you have more evidence, I would really like to see it, I am not just saying that to score points or to make you angry.
It's a fairly extensive subject; I doubt you'll settle this within a comment thread.
With regards to whether it is possible to deliberately use language to alter everyday thoughts, we know Orwell's Newspeak was based on at least one real-life example (and I can think of a couple of similar tricks being employed right now, but this could verge into mind-killing territory).
Fair points, and using the term control does make the claim sound a whole heap stronger than 'are influenced' does. (Although technically there is very little difference.)
I refer not to my own sense so much as what is more or less universally acknowledged by influential thinkers in that field. That doesn't preclude the culture being wrong, but I do put Paul Graham on approximately the same level as Pinker, for example.
While Pinker is an extremely good populariser and writes some engaging accounts that are based off real science, I've actually been bitten by taking his word on faith too much before. He has a tendency to present things as established fact when they are far from universally agreed upon in the field and may not even be the majority position. The example that I'm thinking of primarily is what he writes about fear instincts, regarding to what extent fear of snakes (for example) is learned vs instinctive. His presentation of what has been determined by primate studies is, shall we say, one sided at best.
I guess you are referring to Newspeak, which is in "1984" whereas pigs are in "Animal Farm". If you wish to read either, (George) Orwell's writings and books are available online for free (I don't know what the copyright situation is) here:
http://www.george-orwell.org/
My point was that I was not referring to anything by Orwell, having read none of his works.
Thankyou for the link. I suppose I wouldn't be doing my nerdly duty if I didn't read Orwell eventually. Even though from what I've seen the sophisticated position is to know what's in Orwell but to look down your nose at him somewhat for being simplistic.
I disagree with you at least as strongly, but since I have a deadline to meet I'll have to leave it at that.
Understood.
Of note is that Lojban doesn't fall into that chair trap in particular. I can easily talk about "le stizu" the same way I use "the chair" in English.
More literally, "le stizu" means "the particular chair(s) which in context I'm obviously referring to". Lojban is all about using context to reduce unneccessary verbiage, same as a natural language. The big difference is that the ambiguity in Lojban is easier to locate, and easier to reduce when it becomes necessary.
(Also, if I really did need chair^1 and chair^2 for some reason, I can just talk about "le stizu goi ko'a" and "le stizu goi fo'a", then later use just "ko'a" and "fo'a" for shorthand).
One of the more interesting things I noticed in Lojban is that the underlying structure is this awesome predicate logic, but the way it's actually used by most people is very similar to other natural languages, just with some nifty tricks stolen from programming to supplement it.
Would it bother you if I PMed you with some questions about the stuff I'm working on? I've spent as long on Lojban as I had time to (read: not long enough) but I'm worried I might have gotten the details wrong, or missed something even niftier that deserves an example
Go ahead, though you should be aware that I am far from an expert on Lojban.
I also recommend the FreeNode #lojban channel, they've always been friendly and helpful whenever I've stopped by.
I did a little reading about General Semantics after running into it in SF like Frank Herbert's; my general take on it is that it's an extended reminder that 'the map is not the territory' and that we do not have access to any eternal verities or true essences but only our tentative limited observations.
Exercises like writing in E-Prime remind us of our own fallibility. We should not say 'Amanda Knox is innocent' (who are we, an omniscient god judging her entire life?) but 'Amanda Knox likely did not commit that murder and I base this probability on the following considerations...' (note that I don't hide my own subjective role by saying something like 'the probability is based on').
(I've never found E-Prime very useful because I've always been rather empiricist in philosophy outlook and aware that I should always be able to reduce my statements down to something referring to my observations, and I suspect most LWers would not find E-Prime useful or interesting for much the same reason. But I could see it being useful for normal people.)
In this specific anecdote, the students are mistaking map for territory. The biscuit is perfectly good to eat as dog food is produced to pretty similar quality levels (and health problems would be very unlikely even if the quality were much lower), they have just eaten and enjoyed some anyway, the label 'dog biscuit' only refers to one potential use out of a great many, and yet they still have these incredible reactions to a particular label being put on this agglomeration of wheat and other agricultural products, a reaction that has no utility and no reason behind it.
EDIT: an earlier comment of mine on E-Prime: http://lesswrong.com/lw/9g/eprime/6hk
I personally think of it as a tool, not unlike "lint" for C programmers. It shows things in your code (speech) that may contain errors.
To put it another way, if you know how to spot what isn't E-Prime in a sentence, you can dissect the sentence to expose flawed reasoning... which actually turns out to be a pretty useful tool in e.g. psychotherapy.
Whether or not RET (rational-emotive therapy) and CBT (cognitive behavioral therapy) directly derive from General Semantics and E-Prime (or their logical successor, the linguistic meta-model), modern psychotherapy is all about map-territory separation and map repair.
-- René Magritte, on his painting The Treachery of Images depicting a pipe with "Ceci n'est pas une pipe" ("This is not a pipe") written under it
-- Jack T. Chick
That guy would've gone through hell in high school unless he was really good at sport. :P
Wouldn't surprise me if he'd been home-schooled.
Or really funny. When I was in school I know I thought those little booklets were hilarious.
Err... booklets? Am I missing something here? Oh, are you talking about airplane flights?
"Chick tracts are short evangelical-themed tracts created by American publisher Jack Chick."
Ahh, thanks. I don't think we ever got those here.
Ooh, they are insane. You can read many or all of them online. This one ("Dark Dungeons") is a favorite of mine.
Edit: As mentioned in the Wikipedia article, an earlier version of "Dark Dungeons" (the one that was my introduction to Chick tracts a couple decades ago) listed C. S. Lewis and J. R. R. Tolkien as occult authors whose books should be burned.
That's brilliant. :P
I have a notion that the Chick flavor of Christianity is trying to set itself up as the monopoly supplier of fantasy.
Jack T. Chick draws religious comics called Chick tracts.
Well, Jack doesn't want any thinking at all, so I'm not sure if that's better or worse than fuzziness.
Compare:
-- Richard Dawkins
I was about to stand and applause, until I realized...
Let's say I like flying, I like the earth's ecology, I think large-scale flying is killing the earth's ecology, I think my individual flying is not capable of making a difference to the planet's ecology, and I think technologically advanced cultures capable of sustaining commercial human flight only appear superior because they're able to offload the costs of their advancement to the rest of the earth's population [1].
And I'm at 30,000 feet. Am I a hypocrite?
Worse, am I Richard Dawkins, once you clip of the last item on the first paragraph?
[1] Not my actual beliefs. Except one.
I think you may have misunderstood the point Dawkins was making. It wasn't "if you're in an aeroplane, you aren't entitled to denigrate the society whose achievements made that possible". It was "If you're in an aeroplane, you aren't entitled to claim that all truth is relative, because the fact that the aeroplane stays in the air is dependent on a very particular set of notions about truth, which demonstrably work better than their rivals -- as demonstrated by the fact that our aeroplanes actually fly."
Some context that may be helpful.
Okay, point taken. But to nitpick, that sounds more like epistemological relativism than cultural -- though he can be forgiven for not expecting his audience to be sensitive to the difference. And the context makes it clear too.
I'm continually amused by the abundance of quotes here on LW from sundry wingnuts and theists, some of which are quite good. We've had Jack Chick, Ted Kaczynski, CS Lewis (howdya like that reference class, Lewis), GK Chesterton, and that crazy "Einstein was wrong!" guy.
Maybe being a contrarian in anything whatsoever helps one to break through the platitudes and cached thoughts that ordinary folks seem to bog down in whenever they try to think.
There's also a certain fun challenge in looking for jewels among the fecal matter. Rationalist aphorisms by Voltaire or Russell are a regular feature of their writing, and have been quoted in books and articles for decades or centuries, but a pearl of wisdom by a fideist is a tough find and most likely unknown to other LW readers.
Heh. Of all goddamn things to be a hipster about, "rationality quotes" has got to be one hell of a weird choice.
Do that with the writings of Space Tetrahedron Guy, and then all further Ultimate Space Tetrahedron Documents will have a header text SPACE TETRAHEDRON THEORY IS ENDORSED BY NIHILCREDO.
-- Metallica
--W. K. Clifford, "The Ethics of Belief."
The first line was previously posted in a Rationality Quotes without context or full citation - I consider the additional material sufficient value-added to justify the duplication.
A real-world example of Parfit's Hitchhiker was prominently in the news recently, about firefighters that watched a guy's house burn down because didn't buy a subscription, even though he offered to pay when they arrived at the scene (which I assume means with all the penalties for serving a non-member, etc.). The parallel to PH became clear from this exchange with a writer on Salon:
Obviously, this doesn't carry over the "perfect predictor" aspect, but I'm guessing the FD's decision maker could do much better than chance in guessing whether they'd be able to recover the money -- and the homeowner suffered as a result of not being able to credibly tell the FD (which, of course, has its own subjunctive decision-theoretic concerns about "if I put out the fires of non-payers when they ...") that he would pay later.
(Sorry if this has been posted already, and let me know if this belongs somewhere else like the new discussion forum.)
Update: Okay, it looks like details are in dispute -- by some accounts, he wasn't offering the penalty rate, and people dispute whether the nonpayment was deliberate or an oversight (and the evidence strongly favors the former). "You'll say anything", indeed.
I assumed that the firefighters didn't accept the offer to pay them on the spot because that would send the signal to all the other houseowners that they could skip the regular fire department fee and then make an emergency payment when their house catches fire.
Okay, but that wouldn't be a free ride if the emergency payment were high enough -- the guy wasn't saying, "okay, fine, I'll pay this year's subscription fee -- now will you put out the fire?" He was offering the higher amount (which isn't credible, because the court wouldn't enforce it because if your house is burning, you'll lie, knowing you won't pay, because the court won't enforce ...).
(Long ago, I had this image in my mind of a rude, doesn't-get-it guy who didn't buy car insurance, didn't understand car insurance, and then when his car was wrecked, visits an insurance company, expecting a payout. When they don't pay out, he sighs and says, "Fine, how much is a month of coverage? There -- there you go. NOW will you pay for my car?"
That's not what's going on here.)
Multiple paragraph parenthesising - nice!
An analogy that fits better is that of simple gym membership. "I haven't paid a gym membership for this year but I really want to go to the gym today. How much do you charge?" There is no particularly good reason why the fire putting out service must be a subscription service or insurance model.
The ambulance service, at least the one we have here, seems to be practical. You can get a membership. If you don't have one then when you wake up in hospital you'll have a bill to pay. If you needed a helicopter rescue it'll be a big bill.
Wow. I just felt a surge of patriotism. I had no idea that sort of system was in place in any first world country. I'm sure it's all Right, True, and Capitalistic but I must say I prefer the system here.
In fact, in rural areas (where I grew up) most firefighters are actually volunteers. Those that I knew considered the drastic enhancement to sexual attractiveness to be more than enough payment. ;)
It's a government-run fire station, so it's not all that capitalistic.
Really? Going for a 'worst of both worlds' approach it would seem. ;)
If you are going to make fire fighting a pay for individual service system instead of a cooperation problem handled by central authority and taxation then you may as well at least get the efficiency benefits of competition in private industry. In fact a completely capitalistic organisation with no interest in public welfare would probably not have had a problem like we see in this instance. The organisation would have set up payment contingencies such that they can sell their services at a penalty rate to those who didn't buy according to the preferred subscription/insurance model.
Great quote, but what's with the quotation marks?
It looks like this is actually a quote from Carolyn Merchant's The Death of Nature; only the parts in quotation marks are Bacon's words, taken from "The Great Instauration", "The Masculine Birth of Time", and "De Dignitate".
Confirmed from the linked Amazon.com page by searching the preview for "searchers and spies of nature" (no quotes).
That's exactly what I did! (And looked up the sources in the endnotes.)
It is the very essence of the negation of the environmentalism. Too rational, too heartless quote for many readers of this page.
I interpreted it as a call for experiment, not industry. I could very well be wrong.
edw519, Hacker News, on debugging.
I always need that list, too.
Prompted by the discussion of Sam Harris's idea that science should provide for a universal moral code, I thought of this suitable reply given long ago:
(It also provides for some interesting perspective on the current epistemological state of various academic fields that are taken seriously as a source of guidance for government policy.)
"You can always reach me through my blog!" he panted. "Overpowering Falsehood dot com, the number one site for rational thinking about the future--"
Go ahead, down-vote me. It's still paradoxically-awesome to be burned in a Greg Egan novel...
Oh, I see - the ref is to 'Overcoming Bias.com'. For a moment I was confused because overpoweringfalsehood.com doesn't work and I didn't see any URL in your profile and I thought you were talking about you being burned and not all of us.
What is the context of the quote? Is the OF.com guy a total dolt, an arrogant twat, a cloud cuckoolander, or what?
Found a couple of semi-spoilery reviews for Zendegi. Apparently it has stand-ins for Robin Hanson and SIAI as foils for the authorial message.
Thought this was worthy of its own thread in Discussion so interested people won't miss it: http://lesswrong.com/r/discussion/lw/2ti/greg_egan_disses_standins_for_overcoming_bias/
-- Brahma, Mahabharata
— Marcus Aurelius
-- old Sufi parable
-- unknown