You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

buybuydandavis comments on Does utilitarianism "require" extreme self sacrifice? If not why do people commonly say it does? - Less Wrong Discussion

7 Post author: Princess_Stargirl 09 December 2014 08:32AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (99)

You are viewing a single comment's thread. Show more comments above.

Comment author: SilentCal 15 December 2014 10:21:29PM 0 points [-]

Interesting, our differences are deeper than I expected!

Do you feel you have a good grip on my foundations, or is there something I should expand on?

Let me check my understanding of your foundations: You make decisions to satisfy your own preferences. Some of these might be 'social preferences', which might include e.g. a preference for fewer malaria deaths in the developing world, which might lead you to want to donate some of your income to charity. You do not admit any sense in which it would be 'better' to donate more of your income than you want to, except perhaps by admitting meta-preferences like "I would prefer if I had a stronger preference for fewer malaria deaths".

When you say someone is obligated to do X, you mean that you would prefer that they be coerced to do X. (I hesitate to summarize it this way, though, because it means that if you say they're obligated and I say they aren't, we haven't actually contradicted each other).

Is the above a correct description of your approach?

Comment author: buybuydandavis 19 December 2014 03:03:29AM 0 points [-]

You make decisions...

It's not just me. This is my model of human moral activity. We're social animals with some built in social preferences, along with other built in preferences.

You do not admit any sense in which it would be 'better'

I could come up with a zillion different "betters" where that was the case, but that doesn't mean that I find it better overall according to my values.

When you say someone is obligated to do X, you mean that you would prefer that they be coerced to do X.

That's too strong for some cases, but it was my mistake for saying it so categorically in the first place. I can think of a lot of things I consider interpersonal obligations where I wouldn't want coercion/violence used against them in retaliation. I will just assign you a few asshole points, and adjust my behavior accordingly, possibly including imposing costs on you out of spite.

That's the thing. The reality of our preferences is that they weren't designed to fit into boxes. Preferences are rich in structure, and your attempt to simplify them to one preference ranking to rule them all just won't adequately model what humans are, no matter how intellectually appealing.

We have lots of preference modalities, which have similarities and differences with moral preferences. It tends to be a matter of emphasis and weighting. For example, a lot of our status or beauty preferences function in some way like our moral preferences. Low status entails greater likelihood of punishment, low status rubs off by your failure to disapprove of low status, and both of those occur at higher orders as well - such as if you don't disapprove of someone who doesn't disapprove of low status.

In what people call moral concerns, I observe that higher order punishing/rewarding is more pronounced than for other preferences, such as food tastes. If you prefer mint ice cream, it generally won't be held against you, and most people would consider it weird to do so. If you have some disapproved of moral view, it is held against you, whether you engage in the act or not, and it is expected that it will be held against you.