Roko comments on Strong moral realism, meta-ethics and pseudo-questions. - Less Wrong

18 [deleted] 31 January 2010 08:20PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (172)

You are viewing a single comment's thread. Show more comments above.

Comment author: Eliezer_Yudkowsky 31 January 2010 11:13:57PM 10 points [-]

But then morality does not have as its subject matter "Life, consciousness, and activity; health and strength; pleasures and satisfactions of all or certain kinds; happiness, beatitude, contentment, etc.; truth; knowledge and true opinions of various kinds, understanding, wisdom; beauty, harmony, proportion in objects contemplated; aesthetic experience; morally good dispositions or virtues; mutual affection, love, friendship, cooperation; just distribution of goods and evils; harmony and proportion in one's own life; power and experiences of achievement; self-expression; freedom; peace, security; adventure and novelty; and good reputation, honor, esteem, etc."

Instead, it has primarily as its subject matter a list of ways to transform the universe into paperclips, cheesecake, needles, orgasmium, and only finally, a long way down the list, into eudaimonium.

I think this is not the subject matter that most people are talking about when they talk about morality. We should have a different name for this new subject, like "decision theory".

Comment author: Furcas 31 January 2010 11:42:16PM *  8 points [-]

I think this is not the subject matter that most people are talking about when they talk about morality.

True, as long as they're talking about the stuff that is implied by their terminal values.

However, when they start talking about the stuff that is implied by other people's (or aliens', or AIs') terminal values, the meaning they attach to the word 'morality' is a lot closer to the one I'm proposing. They might say things like, "Well, female genital mutilation is moral to Sudanese people. Um, I mean, errr, uh...", and then they're really confused. This confusion would vanish (or at least, would be more likely to vanish) if they were forced to say, "Well, female genital mutilation is Sudanese-moral but me-immoral."

Ideally, to avoid all confusion we should get rid of the word morality completely, and have everyone speak in terms of goals and desires instead.

Comment author: Jordan 01 February 2010 06:39:11AM *  3 points [-]

Agreed. If it happened that there were only a few different sets of terminal values in existence, then I would be OK with assigning different words to the pursuit of those different sets. One of those words could be 'moral'. However, as is, the set of all terminal values represented by humans is too fractured and varied.

A large chunk of the list Eliezer provides in the above comment probably is nearly universal to humanity, but the entire list is not, and there are certainly many disputes on the relative ordering (especially as to what is on top).