Perplexed comments on Offense versus harm minimization - Less Wrong

60 Post author: Yvain 16 April 2011 01:06AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (417)

You are viewing a single comment's thread. Show more comments above.

Comment author: Perplexed 16 April 2011 01:56:14PM 2 points [-]

In a world where people make decisions according to this principle, one has the incentive to self-modify into a utility monster who feels enormous suffering at any actions of other people one dislikes for whatever reason.

The incentive is weaker than you seem to suggest. Surely, I gain nothing tangible by inducing people to tiptoe carefully around my minefield. Only a feeling of power, or perhaps some satisfaction at having caused inconvenience to my enemies. So, what is the more fruitful maxim to follow so as to discourage this kind of thing?

  • Don't feed the utility monster.

or

  • Poke the utility monster with a stick until it desensitizes.

Somehow I have to think that poking is a form of capitulation to the manipulation - it is voluntary participation in a manufactured drama.

Comment author: florian 16 April 2011 03:59:25PM 10 points [-]

The incentive is weaker than you seem to suggest. Surely, I gain nothing tangible by inducing people to tiptoe carefully around my minefield.

Yes, you do. If everything unpleasant to you causes you a huge amount of suffering instead of, say, mild annoyance, other people (utilitarians) will abstain from doing things that are unpleasant to you as the negative utility to you outweighs the positive utility to them.

Comment author: Perplexed 16 April 2011 05:18:16PM 4 points [-]

What you say is certainly true if the utility monster is simply exaggerating. But I understood VM to be discussing someone who claims offense where no offense (or negligible offense) actually exists. Or, someone who self-modifies to sincerely feel offended, though originally there was no such sensitivity.

But in any case, the real source of the problem in VM's scenario is adhering to an ethical system which permits one to be exploited by utility monsters - real or feigned. My own ethical system avoids being exploited because I accept personal disutility so as to produce utility for others only to the extent that they reciprocate. So someone who exaggerates the disutility they derive from, say, my humming may succeed in keeping me silent in their presence, but this success may come at a cost regarding how much attention I pay to their other desires. So the would-be utility monster is only hurting itself by feeding me false information about its utility function.

Comment author: Vladimir_M 17 April 2011 11:27:52PM 15 points [-]

But I understood VM to be discussing someone who claims offense where no offense (or negligible offense) actually exists.

The crucial point is that the level of offense at a certain action -- and I mean real, sincerely felt painful offense, not fake indignation -- is not something fixed and independent of the incentives people face. This may seem counterintuitive and paradoxical, but human brains do have functions that are not under direct control of the conscious mind, and are nevertheless guided by rational calculations and thus respond to incentives. People creating drama and throwing tantrums are a prime example: their emotions and distress are completely sincere, and their state of mind couldn't be further from calculated pretense, and yet whatever it is in their brains that pushes them into drama and tantrums is very much guided by rational strategic considerations.

Comment author: Strange7 17 April 2011 11:38:56PM 1 point [-]

Only in the sense that a country with secure borders is hurting itself by forfeiting potential gains from trade. If what they want is to avoid being contaminated by your ideas, to avoid being criticized, that minefield is doing it's job just fine.