I'm with Carroll here; I'm also with you, in the sense that I think there are areas of pretty broad agreement on the moral basics, where questions of fact become very relevant.
One thing I wonder about sometimes is what to do about people who have a pretty alien moral system -- but not completely alien. Fundamentalist Christians, for example. Or people in Asian or African societies where they place a higher value on tradition than on freedom.
Are these people "wrong"? That's a lot of people to place outside the pale of reasonable discussion. There are a lot of non-humanists out there -- at least, to some degree or another. On the other hand, if they start to make things morally worse, by my lights -- if they drive gay teenagers to suicide or cut off girls' clitorises -- then I'm not going to say "meh, to each his own." I don't think we have to let just anything stand unchallenged, in the name of tolerance. On the other hand, if we don't have some notion of tolerance of disagreement, we could become pretty dogmatic and dangerous. I do not want to live in a world where some measure of happiness was maximized ruthlessly without my say-so.
Sam Harris has a new book, The Moral Landscape, in which he makes a very simple argument, at least when you express it in the terms we tend to use on LW: he says that a reasonable definition of moral behavior can (theoretically) be derived from our utility functions. Essentially, he's promoting the idea of coherent extrapolated volition, but without all the talk of strong AI.
He also argues that, while there are all sorts of tricky corner cases where we disagree about what we want, those are less common than they seem. Human utility functions are actually pretty similar; the disagreements seem bigger because we think about them more. When France passes laws against wearing a burqa in public, it's news. When people form an orderly line at the grocery store, nobody notices how neatly our goals and behavior have aligned. No newspaper will publish headlines about how many people are enjoying the pleasant weather. We take it for granted that human utility functions mostly agree with each other.
What surprises me, though, is how much flak Sam Harris has drawn for just saying this. There are people who say that there can not, in principle, be any right answer to moral questions. There are heavily religious people who say that there's only one right answer to moral questions, and it's all laid out in their holy book of choice. What I haven't heard, yet, are any well-reasoned objections that address what Harris is actually saying.
So, what do you think? I'll post some links so you can see what the author himself says about it:
"The Science of Good and Evil": An article arguing briefly for the book's main thesis.
Frequently asked questions: Definitely helps clarify some things.
TED talk about his book: I think he devotes most of this talk to telling us what he's not claiming.