Good post. The various wordy posts over the last month and a half will make a very nice chapter indeed. HOWEVER!
I take issue with #32, as I did in the original post. Perhaps I am the sort of guy who has a Jones for green-eyed, black-haired girls. Now [green-eyes] and [black-hair] may have exactly zero correlation with one another - having one makes you no more or less likely to have the other. However, for ease of reference (which is surely what it's all about anyway) I talk about green-eyed, black-haired girls as 'Wigginettes'. Now as long as I'm careful not to sneak in any connotations or start pigeonholing, how is 'Wigginettes' wrong?
Being my own Devil's Advocate for a sec - I understand how a word that doesn't correspond to a pattern in Thingspace doesn't describe anything coherent in Reality-Land. And that's fine. Outside my head, and the heads of people I talk to, sure, Wigginettes is a Wrong Word.
However, as Eliezer points out, we tailor our use of language to what is useful, what helps us get by. Pigheaded obstinacy and nitpicking are bad for communication, not good. People have utility functions, and language should be a tool for moving us in the right directions. Wigginettes does that for me, regardless of whether or not it describes a cluster.
Perhaps I am the sort of guy who has a Jones for green-eyed, black-haired girls.
Then [green eyes], [girl], and [black hair] are positively correlated with [has a Jones for]. Which is a valid Bayesian inference.
Some reader is bound to declare that a better title for this post would be "37 Ways That You Can Use Words Unwisely", or "37 Ways That Suboptimal Use Of Categories Can Have Negative Side Effects On Your Cognition".
But one of the primary lessons of this gigantic list is that saying "There's no way my choice of X can be 'wrong'" is nearly always an error in practice, whatever the theory. You can always be wrong. Even when it's theoretically impossible to be wrong, you can still be wrong. There is never a Get-Out-Of-Jail-Free card for anything you do. That's life.
Besides, I can define the word "wrong" to mean anything I like - it's not like a word can be wrong.
Personally, I think it quite justified to use the word "wrong" when:
Everything you do in the mind has an effect, and your brain races ahead unconsciously without your supervision.
Saying "Words are arbitrary; I can define a word any way I like" makes around as much sense as driving a car over thin ice with the accelerator floored and saying, "Looking at this steering wheel, I can't see why one radial angle is special - so I can turn the steering wheel any way I like."
If you're trying to go anywhere, or even just trying to survive, you had better start paying attention to the three or six dozen optimality criteria that control how you use words, definitions, categories, classes, boundaries, labels, and concepts.