You say,
the versions of "mature folk morality" and "reflective equilibrium" and "analytic descriptivism" and "moral functionalism" are never quite exactly right, they are built on entirely different premises of argument and never quite optimized for Friendly-AI thinking.
and that you prefer to "invent all these things the correct way".
From this and your preceding text I understand,
that philosophers have identified some meta-ethical theses and concepts similar to concepts and theses you've invented all by yourself,
that the philosophers' theses and concepts are in some way systematically defective or inadequate, and
that the arguments used to defend the theses are different than the arguments which you would use to defend them.
(I'm not sure what you mean in saying the concepts and theses aren't optimized for Friendly-AI thinking.)
You imply that you've done a comprehensive survey, to arrive at these conclusions. It'd be great if you could share the details. Which discussions of these ideas have you studied, how do your concepts differ from the philosophers', and what specifically are the flaws in the philosophers' versions? I'm not familiar with these meta-ethical theses but I see that Frank Jackson and Philip Pettit are credited with sparking the debate in philosophy - what in their thinking do you find inadequate? And what makes your method of invention (to use your term) of these things the correct one?
I apologize if the answers to these questions are all contained in your sequences. I've looked at some of them but the ones I've encountered do not answer these questions.
You disparage the value of philosophy, but it seems to me you could benefit from it. In another of your posts, 'How An Algorithm Feels From Inside', I came across the following:
When you look at a green cup, you don't think of yourself as seeing a picture reconstructed in your visual cortex - although that is what you are seeing - you just see a green cup. You think, "Why, look, this cup is green," not, "The picture in my visual cortex of this cup is green."
This is false - the claim, I mean, that when you look at a green cup, you are seeing a picture in your visual cortex. On the contrary, the thing you see is reflecting light, is on the table in front of you (say), has a mass of many grams, is made of ceramic (say), and on an on. It's a cup -it emphatically is not in your brainpan. Now, if you want to counter that I'm just quibbling over the meaning of the verb 'to see', that's fine - my point is that it is you who are using it in a non-standard way, and it behoves you to give a coherent explication of your meaning. The history of philosophical discussions suggests this is not an easy task. The root of the problem is the effort to push the subject/object distinction -which verbs of perception seem to require- within the confines of the cranium. Typically, the distinction is only made more problematic - the object of perception (now a 'picture in the visual cortex') still doesn't have the properties it's supposed to (greenness), and the subject doing the seeing seems even more problematic. The self is made identical to or resident within some sub-region of the brain, about which various awkward questions now arise. Daniel Dennett has criticized this idea as the 'Cartesian Theatre' model of perception.
Having talked to critics of philosophy before, I know such arguments are often met with considerable impatience and derision. They are irrelevant to the understanding being sought, a waste of time, etc. This is fine - it may be true, for many, including you. If this is so, though, it seems to me the rational course is simply to acknowledge it's concerns are orthogonal to your own, and if you seem to come into collision (as above), to show that your misleading metaphor isn't really doing any work, and hence is benign. In this case you aren't re-inventing the wheel in coming up with your own theories, but something altogether different - a skid, maybe.
Part of the sequence: Rationality and Philosophy
Despite Yudkowsky's distaste for mainstream philosophy, Less Wrong is largely a philosophy blog. Major topics include epistemology, philosophy of language, free will, metaphysics, metaethics, normative ethics, machine ethics, axiology, philosophy of mind, and more.
Moreover, standard Less Wrong positions on philosophical matters have been standard positions in a movement within mainstream philosophy for half a century. That movement is sometimes called "Quinean naturalism" after Harvard's W.V. Quine, who articulated the Less Wrong approach to philosophy in the 1960s. Quine was one of the most influential philosophers of the last 200 years, so I'm not talking about an obscure movement in philosophy.
Let us survey the connections. Quine thought that philosophy was continuous with science - and where it wasn't, it was bad philosophy. He embraced empiricism and reductionism. He rejected the notion of libertarian free will. He regarded postmodernism as sophistry. Like Wittgenstein and Yudkowsky, Quine didn't try to straightforwardly solve traditional Big Questions as much as he either dissolved those questions or reframed them such that they could be solved. He dismissed endless semantic arguments about the meaning of vague terms like knowledge. He rejected a priori knowledge. He rejected the notion of privileged philosophical insight: knowledge comes from ordinary knowledge, as best refined by science. Eliezer once said that philosophy should be about cognitive science, and Quine would agree. Quine famously wrote:
But isn't this using science to justify science? Isn't that circular? Not quite, say Quine and Yudkowsky. It is merely "reflecting on your mind's degree of trustworthiness, using your current mind as opposed to something else." Luckily, the brain is the lens that sees its flaws. And thus, says Quine:
Yudkowsky once wrote, "If there's any centralized repository of reductionist-grade naturalistic cognitive philosophy, I've never heard mention of it."
When I read that I thought: What? That's Quinean naturalism! That's Kornblith and Stich and Bickle and the Churchlands and Thagard and Metzinger and Northoff! There are hundreds of philosophers who do that!
Non-Quinean philosophy
But I should also mention that LW philosophy / Quinean naturalism is not the largest strain of mainstream philosophy. Most philosophy is still done in relative ignorance (or ignoring) of cognitive science. Consider the preface to Rethinking Intuition:
Conclusion
So Less Wrong-style philosophy is part of a movement within mainstream philosophy to massively reform philosophy in light of recent cognitive science - a movement that has been active for at least two decades. Moreover, Less Wrong-style philosophy has its roots in Quinean naturalism from fifty years ago.
And I haven't even covered all the work in formal epistemology toward (1) mathematically formalizing concepts related to induction, belief, choice, and action, and (2) arguing about the foundations of probability, statistics, game theory, decision theory, and algorithmic learning theory.
So: Rationalists need not dismiss or avoid philosophy.
Update: To be clear, though, I don't recommend reading Quine. Most people should not spend their time reading even Quinean philosophy; learning statistics and AI and cognitive science will be far more useful. All I'm saying is that mainstream philosophy, especially Quinean philosophy, does make some useful contributions. I've listed more than 20 of mainstream philosophy's useful contributions here, including several instances of classic LW dissolution-to-algorithm.
But maybe it's a testament to the epistemic utility of Less Wrong-ian rationality training and thinking like an AI researcher that Less Wrong got so many things right without much interaction with Quinean naturalism. As Daniel Dennett (2006) said, "AI makes philosophy honest."
Next post: Philosophy: A Diseased Discipline
References
Dennett (2006). Computers as Prostheses for the Imagination. Talk presented at the International Computers and Philosophy Conference, Laval, France, May 3, 2006.
Kahneman, Slovic, & Tversky (1982). Judgment Under Uncertainty: Heuristics and Biases. Cambridge University Press.
Nisbett and Ross (1980). Human Inference: Strategies and Shortcomings of Social Judgment. Prentice-Hall.
Rips (1975). Inductive judgments about natural categories. Journal of Verbal Learning and Behavior, 12: 1-20.
Rosch (1978). Principles of categorization. In Rosch & Lloyd (eds.), Cognition and Categorization (pp. 27-48). Lawrence Erlbaum Associates.
Rosch & Mervis (1975). Family resemblances: studies in the internal structure of categories. Cognitive Psychology, 8: 382-439.
Smith & Medin (1981). Concepts and Categories. MIT Press.