This summary is quite useful. Eliezer, it would be very nice if you added forward links to your post. I often find myself wanting to recommend reading a series you've written to a friend, but in order to read it they would need to start at the end and link their way back to the beginning. If a link to follow ups were provided at the top or bottom of prior posts, it would make these a lot easier to follow write on a particular topic, since I could recommend one post and my friend could hopefully figure out the rest.
Hmm... while these are all useful guidelines for how to use words, but I don't think all of them define wrong ways of using words. For example "You use a short word for something that you won't need to describe often, or a long word for something you'll need to describe often. This can result in inefficient thinking, or even misapplications of Occam's Razor, if your mind thinks that short sentences sound "simpler"" Which sounds more plausible, "God did a miracle" or "A supernatural universe-creating entity temporarily s...
Oh, the irony.
It doesn't matter that Eliezer defined the word "wrong" in a different way than you. You still understand what he means, there's no point to redefining "wrong" in this case.
What's the bad thing that happens if I do 35? It's a mistake, but how will it prevent me from using words correctly? I'd still be able to imagine a triangular lightbulb.
Good post. The various wordy posts over the last month and a half will make a very nice chapter indeed. HOWEVER!
I take issue with #32, as I did in the original post. Perhaps I am the sort of guy who has a Jones for green-eyed, black-haired girls. Now [green-eyes] and [black-hair] may have exactly zero correlation with one another - having one makes you no more or less likely to have the other. However, for ease of reference (which is surely what it's all about anyway) I talk about green-eyed, black-haired girls as 'Wigginettes'. Now as long as I'm careful not to sneak in any connotations or start pigeonholing, how is 'Wigginettes' wrong?
Being my own Devil's Advocate for a sec - I understand how a word that doesn't correspond to a pattern in Thingspace doesn't describe anything coherent in Reality-Land. And that's fine. Outside my head, and the heads of people I talk to, sure, Wigginettes is a Wrong Word.
However, as Eliezer points out, we tailor our use of language to what is useful, what helps us get by. Pigheaded obstinacy and nitpicking are bad for communication, not good. People have utility functions, and language should be a tool for moving us in the right directions. Wigginettes does that for me, regardless of whether or not it describes a cluster.
Perhaps I am the sort of guy who has a Jones for green-eyed, black-haired girls.
Then [green eyes], [girl], and [black hair] are positively correlated with [has a Jones for]. Which is a valid Bayesian inference.
Definitely one of the most useful posts I've seen on overcoming bias. I shall be referring back to this list often. I am surprised though, that you did not reference that incisive philosopher, Humpty Dumpty, who had views about a word meaning exactly what he wanted it to mean :) While I haven't thought through the taxonomy of failures through quite as thoroughly, I spent a fair amount of time figuring out the uses of the words 'strategy' and 'tactics' in collaboration with a philosopher of language, and wondering about the motivated bias that enters into d...
Caledonian - I don't think anyone's suggesting that a word can be 'wrong' in and of itself. Of course it comes down to usage; usage is what gives words their power (for good or bad). The idea is that words can be defined or used in such a way that they do not help us describe reality, hence a 'wrong word'. I'm sure you're aware of this.
Of course you can define a word any way you like, no-one's going to stop you doing so. However, some consideration is required if you wish to communicate (and, often, think) effectively. I'm sure you agree with this as well, so:
Demonstrate, without using any of the loaded terms involved, how and where you disagree with the original post.
You say: "The act of defining a word to refer to all humans, except black people, seems kind of suspicious"
This is gratuitously emotive and doesn't help to clarify your point.
Are you hoping to impress with your egalitarian conscience? Or are you hoping to politically bully your readers into agreement?
Please allow your arguments to rest on their own merits.
Wigginettes does that for me, regardless of whether or not it describes a cluster.
Isn't it describing the cluster of women whom you expect to be attracted to? Surely one of the dimensions in your the subset of thingspace that you work with can be based upon your expected reaction to a set of physical features.
Great post, Eliezer.
On a separate note, a lot of readers here would probably like Venkat's blog linked above.
iwdw,
You draw your boundary around a volume of space where there is no greater-than-usual density
This suggests otherwise.
Remember, Thingspace doesn't morph to one's utility function - it is a representation of things in reality, outside one's head. Wigginettes aren't an identifiable cluster in Thingspace, since the two attributes they all possess aren't correlated in any way, in stark and shocking defiance of #32.
Seriously though, I'm a sucker for dark hair and green eyes.
Manon: What's the bad thing that happens if I do 35?
You waste years of your life on dreadful AI designs based around suggestively named LISP tokens. See Drew McDermott's classic Artificial Intelligence Meets Natural Stupidity. More on this later.
Ben Jones: Perhaps I am the sort of guy who has a Jones for green-eyed, black-haired girls.
Yes, by putting arbitrary boundaries into the utility function, I can force an AI to develop concepts for things that are bound only by those boundaries. But human utility boundaries are typically around otherwise-intere...
You waste years of your life on dreadful AI designs based around suggestively named LISP tokens. See Drew McDermott's classic Artificial Intelligence Meets Natural Stupidity. More on this later.
I take it that Eliezer is not a fan of Cyc.
@Ben Jones:
Remember, Thingspace doesn't morph to one's utility function - it is a representation of things in reality, outside one's head.
But... your head is part of reality, is it not?
Could you not theoretically devise an experiment that showed a correlation between the presence of black hair / green eyes and biochemical changes in your brain and hormonal systems?
This particular cluster in Thingspace - female features which Ben Jones, specifically, finds attractive - may not be of any use to anyone but you (with the possible exception of women in your soc...
Eliezer: "In the original case, I talked about wiggins. Here, summarizing, I have to pick a better-known example of how arbitrarily excluding something is not only bad, but a case of trying to get away with something without justifying it."
At the risk (certainty?) of sounding churlish, ad Hitlerum is not a convenient shorthand. It's a logical fallacy which you've used a couple of times here. Being on guard against such thought patterns is the point of this blog.
Suppose that I referred to the non-human status of a 20 week foetus as an example of h...
"You waste years of your life on dreadful AI designs based around suggestively named LISP tokens." -> Actually it's worse. Any theory of mind that contradicts subjective experience must dismiss it (cf Behaviorism). Experience is an axiomatic fact. Putting theory before facts locally destroys science and stalls any attempt to progress beyond that point - it becomes a "semantic stop-sign".
Ben - remember that the original article referenced in point #32 stated that it was useful to have a word for something with traits A and B if (A correlates with B) OR (A,B correlates with something else, C). So even though green eyes do not positively correlate with dark hair, the combination does correlate with your desire.
I know this is basically repeating what others have already said, but I just wanted to stress that A nd B do not have to correlate.
it was useful to have a word for something with traits A and B if (A correlates with B) OR (A,B correlates with something else, C)
It's useful to have a word for such a thing even if we can predict nothing more from A and B.
But... your head is part of reality, is it not?
I sometimes wonder. Maybe it's the other way round....
iwdw & Dave - it's a tempting idea, but I'd say that ultimately it's wrong.
My liking of Wigginettes is a fact about me, not a fact about Wigginettes. I can't spontaneously create a new Thingspace dimension, say 'look, Wigginettes glow when you look through this dimension, hence Wigginettes is an objectively valid category'. My liking is based on two unrelated properties, A and B, and maybe that 'creates' a third property C, but that property only descri...
Referring to objective properties statistically associated is not the only purpose of language, and it's not the only way language helps us think.
Your arguments are predicated upon a false assumption.
@Ben Jones:
I don't disagree about the utility of the term, I'm just trying to figure out what should be considered a dimension in "thingspace" and what shouldn't. Obviously our brain's hormonal environment is a rather important and immediate aspect of the environment, so we tend to lend undue importance to those things which change it.
To continue to play Devil's Advocate, where does the line get drawn?
If you extend the hypothetical experiment out to a sufficiently sized random sampling of other people, and find that Wigginettes are more likely t...
My first thought was to bookmark this so that I can name numbers whenever I'm having a disagreement on the Internet. This list is an excellent Fully General Counterargument.
You give an absolute train wreck of a purported definition, then do your best to relive the crash over and over. Intelligence is not merely objective reason, but includes nonlinear subconscious processing, intuition, and emotional intelligence. Therefore, AGI needs quantum computing.
(To be clear, the previous comment was meant as a joke, not as a serious addition to the list -- at least not as it stands :-))
Something seems to have gone wrong with the markup on this page; the list now goes from 1-5 and 1-32 instead of 1-37.
If everyone internalized all the points in this post (especially #11, #18, and #30), I think the world would be a lot better place.
That said, for anyone overwhelmed by the prospect of keeping all these 37 points in mind, there's a much simpler way to encapsulate most of them: Words are not the concepts they represent. That one simple fact people seem to need constant reminding of. Reflecting deeply on the unexpectedly far-reaching implications of this little reminder will probably yield all the rest of the points.
It disgusts me to realize that I make so many mistakes so regularly. Perhaps disgust isn't the right word, though...
This is a good post - there are a good number of philosophers who would benefit from reading this.
I'd like to add a 38, if I may, though it isn't mine. It's what Daniel Dennett calls a "deepity".
A deepity is a statement with two possible interpretations, such as "love is a word".
One of the interpretations is trivially true and trivially unspectacular. In this case, "love" - the word - is a word. The second interpretation is either false or suspect, but if it were true it would be profound. In this case, the non-existence of love as anything other than a verbal construct.
The "deepity" is therefore able to achieve undeserved profundity via a conflation of these two interpretations. People see the trivial but true interpretation and then think that there must be some kind of truth to the false but profound one.
If I were to start referring to apples as, say, "oranges", instead, would I have any right to say someone was "wrong" if they were to call one an "apple"? As many before me have said, it is all a matter of perspective. If a sentence in a book said, "The grass was bloodstained red," the author would be pointing out that the grass is differing from green, which, in the author's perspective, is the expected color for grass.
The post was quite enlightening, very informative.
I'm somewhat new to this site, so if I have managed to use any of my words "wrong" by the definitions listed above, inform me, please.
Which sounds more plausible, "God did a miracle" or "A supernatural universe-creating entity temporarily suspended the laws of physics"?
This specific example was broken for me when I first read it not long after high school. Schooling does some weird things to your brain.
I find a lot of these guidelines to be consistent with my own view. (Especially common and destructive to mental functioning in philosophy is 26.) But, to clarify, this view is one of concepts, not of words, per se. The concept is the actual mental integration for which the word is a conventional symbol. (Different languages assign different words to the same concepts, like "agua" and "water.") Certain concepts can vary from one person/culture to another, but in order to actually be concepts, they must be formed in accordance with a cer...
Given the extent to which the proper use of general categories of reason depends upon the ends you wish to use the concept for, and the extent to which goals and values are entangled, I'm wondering if it's even possible to create an intelligent but non omniscient agent which uses these categories but that does not have some kind of implicit value preference structure.
I don't think it is possible, which makes FAI even harder to achieve.
I think the list strangely avoids a few very useful words and phrases. 5 is the fallacy of Reification, for example - really useful tag for a pervasive error.
Wittgenstein's concept of Family Resemblance would have been very useful in streamlining the several references to definition (e.g. defining a human being).
I also missed Equivocation in there.
(13 seems very dismissive of Platonic Forms - Penrose, for one, might demur.)
A word fails to connect to reality in the first place. Is Socrates a framster? Yes or no?
What does framster mean?
Your argument, if it worked, could coerce reality to go a different way by choosing a different word definition. Socrates is a human, and humans, by definition, are mortal. So if you defined humans to not be mortal, would Socrates live forever? (The Parable of Hemlock.)
I don't understand this one. If you changed the word's definition, wouldn't the argument just then be unsound (though valid)? Argument-by-definition doesn't have a lot going for it, but I don't think this is a problem. Reading the linked article hasn't cleared things up for me. Can anyone explain what's meant here?
Unsupported claim: "Everything you do in the mind has an effect, and your brain races ahead unconsciously without your supervision."
I've studied psychology enough to think this could be a problem, but why should anyone else think so?
This is a powerful point but it's unsupported.
There is also a minor typo: "dis ease" (It's the space.)
- The act of labeling something with a word, disguises a challengable inductive inference you are making. If the last 11 egg-shaped objects drawn have been blue, and the last 8 cubes drawn have been red, it is a matter of induction to say this rule will hold in the future. But if you call the blue eggs "bleggs" and the red cubes "rubes", you may reach into the barrel, feel an egg shape, and think "Oh, a blegg." (Words as Hidden Inferences.)
The alternative is worse. When I talk about a piano, I'm disguising the inference t...
It's a bit unfortunate that these articles are so old; or rather that people aren't as active presently. I'd have enjoyed some discussion on a few thoughts. Take for instance #5, I shall paste it for convenience:
If the last 11 egg-shaped objects drawn have been blue, and the last 8 cubes drawn have been red, it is a matter of induction to say this rule will hold in the future. But if you call the blue eggs "bleggs" and the red cubes "rubes", you may reach into the barrel, feel an egg shape, and think "Oh, a blegg."
It stru...
Yep, nice list. One I didn't see: Defining a word in a way that is less useful (that conveys less information) and rejecting a definition that is more useful (that conveys more information). Always choose the definition that conveys more information; eliminate words that convey zero information. It's common for people to define words that convey zero information. But if everything has the Buddha nature, nothing empirical can be said about what it means and it conveys no information.
Along similar lines, always define words so that no other word conveys...
If my son wanted to be a poet, I'd keep this article away from him. I feel you are at war with the fluidity of language. I can describe what a volcano is to you with these amazing tools that are always subject to mishandling (in 37,000 ways) by speaker or listener, ever inferior to explanation by Action or intimate experience - throwing you into a volcano is real communication!
No. 6 - I go again to logic and formal math, where you can never define any term by extensions because sensory perceptions aren't reliable enough to give the needed certainty of Truths. Then you will have to start from some undefined elementary terms and work up from there. Other than this, though, this rule of thumb seems quite trustworthy.
No. 29 - that's just inaccurate. As you said, there are more and less typical examples of a cluster. Hinduism is a typical example, so we stop there. But if a case is a borderline member of a cluster, you will need to r...
this video has a good guide to how humans use (and misuse) categories: 1. Introduction to Human Behavioral Biology
Some reader is bound to declare that a better title for this post would be "37 Ways That You Can Use Words Unwisely", or "37 Ways That Suboptimal Use Of Categories Can Have Negative Side Effects On Your Cognition".
But one of the primary lessons of this gigantic list is that saying "There's no way my choice of X can be 'wrong'" is nearly always an error in practice, whatever the theory. You can always be wrong. Even when it's theoretically impossible to be wrong, you can still be wrong. There is never a Get-Out-Of-Jail-Free card for anything you do. That's life.
Besides, I can define the word "wrong" to mean anything I like - it's not like a word can be wrong.
Personally, I think it quite justified to use the word "wrong" when:
Everything you do in the mind has an effect, and your brain races ahead unconsciously without your supervision.
Saying "Words are arbitrary; I can define a word any way I like" makes around as much sense as driving a car over thin ice with the accelerator floored and saying, "Looking at this steering wheel, I can't see why one radial angle is special - so I can turn the steering wheel any way I like."
If you're trying to go anywhere, or even just trying to survive, you had better start paying attention to the three or six dozen optimality criteria that control how you use words, definitions, categories, classes, boundaries, labels, and concepts.