Today's post, Is Morality Preference? was originally published on 05 July 2008. A summary (taken from the LW wiki):
A dialogue on the idea that morality is a subset of our desires.
Discuss the post here (rather than in the comments to the original post).
This post is part of the Rerunning the Sequences series, where we'll be going through Eliezer Yudkowsky's old posts in order so that people who are interested can (re-)read and discuss them. The previous post was Moral Complexities, and you can use the sequence_reruns tag or rss feed to follow the rest of the series.
Sequence reruns are a community-driven effort. You can participate by re-reading the sequence post, discussing it here, posting the next day's sequence reruns post, or summarizing forthcoming articles on the wiki. Go here for more details, or to have meta discussions about the Rerunning the Sequences series.
Yes, there's inherently a certain amount of unsatisfying circularity is everything. But that's a weakness that calls for minimization of circularity.
Empiricism has only one circularly justified position: You can (more or less) trust the input of your senses - which implies some consistency over time. Everything else follows from that. Modern science is better than pytolemic science because it makes better predictions.
By contrast, there's essentially no limit to moral circularity. There's the realism premise: There is a part of the territory called "moral rightness". Then you need a circular argument to show any particular moral premise (these killings are unjustified) is part of moral rightness. And there are multiple independent moral premises. (When killing is wrong does not shed much light on when lying is wrong). It's not even clear that there are a finite number of circularly justified assertions.
So I hold empiricism to the same standard as moral realism, and moral realism seems to come up short. Further, my Minimization of Circular Justification principle is justified by worry about the ease of creating a result simply by making in an axiom. (That is, the Pythagorean Theorem is on a different footing if it is introduced as an axiom of Euclidean geometry rather than a derived result).
If your principle is actually that circular justification must be minimized, then why aren't you an anti-realist about both scientific and moral claims? Surely that would involve less circular justification than your current position. You wouldn't even have to commit yourself to the one circularly justified position assumed by empiricism.
In any case, scientific reasoning as a whole does not just reduce to the sort of minimal empiricism you describe. For starters, even if you assume that the input of your senses is trustworthy and will continue to remain tr... (read more)