From the comment by Richard Chappell:
(namely, whatever terminal values the speaker happens to hold, on some appropriate [if somewhat mysterious] idealization).
(i) 'Right' means, roughly, 'promotes external goods X, Y and Z' (ii) claim i above is true because I desire X, Y, and Z.
People really think EY is saying this? It looks to me like a basic Egoist stance, where "your values" also include your moral preferences. That is my position, but I don't think EY is on board.
"Shut up and multiply" implies a symmetry in value between different people that isn't implied by the above. Similarly, the diversion into mathematical idealization seemed like a maneuver toward Objective Morality - One Algorithm to Bind Them, One Algorithm to Rule them All. Everyone gets their own algorithm as the standard of right and wrong? Fantastic, if it were true, but that's not how I read EY.
It's strange, because Richard seems to say that EY agrees with me, while I think EY agrees with him.
I think you are mixing up object-level ethics and metaethics here. You seem to be contrasting an Egoist position ("everyone should do what they want") with an impersonal utilitarian one ("everyone should do what is good for everyone, shutting up and multiplying"). But the dispute is about what "should", "right" and related words mean, not about what should be done.
Eliezer (in Richard's interpretation) says that when someone says "Action A is right" (or "should be done"), the meaning of this is r...
From Costanza's original thread (entire text):
Meta: