Someone asked me via email:
How do you see the analytic/synthetic distinction relating to map/territory? I suspect I read the logical positivists with too much charity, because I fit their arguments into my conception of map and territory. Quine attacked the positivists' view with what I know you've said is a view much like what LessWrong holds.
I figured my answer will be helpful for others, too, so I'll post it here:
The analytic/synthetic distinction is quite different than map/territory. The map/territory distinction is a metaphor that illustrates the correspondence theory of truth which Eliezer endorses but I am unsure of.
The analytic/synthetic distinction was used by the logical empiricists to draw a strict line between sentences that were true in virtue of the relations between the meanings of words (analytic), and sentences that were true in virtue of the relations of the meanings of words plus extralinguistic facts (synthetic).
Quine argued that the distinction can't be made so easily. He gave several arguments for this conclusion. One of the easier-to-summarize ones that I'll use as an example is his argument against sentence-by-sentence meaning. He said that individual sentences taken in isolation from each other do not imply certain anticipations. For that, you need individual sentences plus larger chunks of theory in which the terms of the sentence are embedded. This is one part of Quine's "holism."
More generally, Quine said that Carnap (representing the best of logical positivism in The Logical Structure of the World, which was a masterful step forward for human thought even if it is flawed) and the logical empiricists had failed to provide clear and unambiguous boundaries for the analytic, and that the line between analytic and synthetic was instead quite fuzzy.
As for this: "Quine attacked the positivists' view with what I know you've said is a view much like what LessWrong holds." I don't think I said Quine attacked the positivists' view with a view much like LessWrong's typical view. What I remember saying was that many positive aspects of Quine's worldview resembled standard LessWrong positions, not that his negative work on logical empiricism made use of standard LessWrong positions.
The map/territory distinction is a metaphor that illustrates the correspondence theory of truth which Eliezer endorses but I am unsure of.
Its role in the sequences seems much simpler: if you look at human minds as devices for producing correct (winning) decisions (beliefs), the "map" aspect of the brain is effective to the extent/because the state of the brain corresponds to the state of the territory. This is not correspondence theory of truth, it's theory of (arranging) coincidence between correct decisions/beliefs (things defined in terms o...
Part of the sequence: Rationality and Philosophy
Despite Yudkowsky's distaste for mainstream philosophy, Less Wrong is largely a philosophy blog. Major topics include epistemology, philosophy of language, free will, metaphysics, metaethics, normative ethics, machine ethics, axiology, philosophy of mind, and more.
Moreover, standard Less Wrong positions on philosophical matters have been standard positions in a movement within mainstream philosophy for half a century. That movement is sometimes called "Quinean naturalism" after Harvard's W.V. Quine, who articulated the Less Wrong approach to philosophy in the 1960s. Quine was one of the most influential philosophers of the last 200 years, so I'm not talking about an obscure movement in philosophy.
Let us survey the connections. Quine thought that philosophy was continuous with science - and where it wasn't, it was bad philosophy. He embraced empiricism and reductionism. He rejected the notion of libertarian free will. He regarded postmodernism as sophistry. Like Wittgenstein and Yudkowsky, Quine didn't try to straightforwardly solve traditional Big Questions as much as he either dissolved those questions or reframed them such that they could be solved. He dismissed endless semantic arguments about the meaning of vague terms like knowledge. He rejected a priori knowledge. He rejected the notion of privileged philosophical insight: knowledge comes from ordinary knowledge, as best refined by science. Eliezer once said that philosophy should be about cognitive science, and Quine would agree. Quine famously wrote:
But isn't this using science to justify science? Isn't that circular? Not quite, say Quine and Yudkowsky. It is merely "reflecting on your mind's degree of trustworthiness, using your current mind as opposed to something else." Luckily, the brain is the lens that sees its flaws. And thus, says Quine:
Yudkowsky once wrote, "If there's any centralized repository of reductionist-grade naturalistic cognitive philosophy, I've never heard mention of it."
When I read that I thought: What? That's Quinean naturalism! That's Kornblith and Stich and Bickle and the Churchlands and Thagard and Metzinger and Northoff! There are hundreds of philosophers who do that!
Non-Quinean philosophy
But I should also mention that LW philosophy / Quinean naturalism is not the largest strain of mainstream philosophy. Most philosophy is still done in relative ignorance (or ignoring) of cognitive science. Consider the preface to Rethinking Intuition:
Conclusion
So Less Wrong-style philosophy is part of a movement within mainstream philosophy to massively reform philosophy in light of recent cognitive science - a movement that has been active for at least two decades. Moreover, Less Wrong-style philosophy has its roots in Quinean naturalism from fifty years ago.
And I haven't even covered all the work in formal epistemology toward (1) mathematically formalizing concepts related to induction, belief, choice, and action, and (2) arguing about the foundations of probability, statistics, game theory, decision theory, and algorithmic learning theory.
So: Rationalists need not dismiss or avoid philosophy.
Update: To be clear, though, I don't recommend reading Quine. Most people should not spend their time reading even Quinean philosophy; learning statistics and AI and cognitive science will be far more useful. All I'm saying is that mainstream philosophy, especially Quinean philosophy, does make some useful contributions. I've listed more than 20 of mainstream philosophy's useful contributions here, including several instances of classic LW dissolution-to-algorithm.
But maybe it's a testament to the epistemic utility of Less Wrong-ian rationality training and thinking like an AI researcher that Less Wrong got so many things right without much interaction with Quinean naturalism. As Daniel Dennett (2006) said, "AI makes philosophy honest."
Next post: Philosophy: A Diseased Discipline
References
Dennett (2006). Computers as Prostheses for the Imagination. Talk presented at the International Computers and Philosophy Conference, Laval, France, May 3, 2006.
Kahneman, Slovic, & Tversky (1982). Judgment Under Uncertainty: Heuristics and Biases. Cambridge University Press.
Nisbett and Ross (1980). Human Inference: Strategies and Shortcomings of Social Judgment. Prentice-Hall.
Rips (1975). Inductive judgments about natural categories. Journal of Verbal Learning and Behavior, 12: 1-20.
Rosch (1978). Principles of categorization. In Rosch & Lloyd (eds.), Cognition and Categorization (pp. 27-48). Lawrence Erlbaum Associates.
Rosch & Mervis (1975). Family resemblances: studies in the internal structure of categories. Cognitive Psychology, 8: 382-439.
Smith & Medin (1981). Concepts and Categories. MIT Press.