Perplexed comments on Offense versus harm minimization - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (417)
What you say is certainly true if the utility monster is simply exaggerating. But I understood VM to be discussing someone who claims offense where no offense (or negligible offense) actually exists. Or, someone who self-modifies to sincerely feel offended, though originally there was no such sensitivity.
But in any case, the real source of the problem in VM's scenario is adhering to an ethical system which permits one to be exploited by utility monsters - real or feigned. My own ethical system avoids being exploited because I accept personal disutility so as to produce utility for others only to the extent that they reciprocate. So someone who exaggerates the disutility they derive from, say, my humming may succeed in keeping me silent in their presence, but this success may come at a cost regarding how much attention I pay to their other desires. So the would-be utility monster is only hurting itself by feeding me false information about its utility function.
The crucial point is that the level of offense at a certain action -- and I mean real, sincerely felt painful offense, not fake indignation -- is not something fixed and independent of the incentives people face. This may seem counterintuitive and paradoxical, but human brains do have functions that are not under direct control of the conscious mind, and are nevertheless guided by rational calculations and thus respond to incentives. People creating drama and throwing tantrums are a prime example: their emotions and distress are completely sincere, and their state of mind couldn't be further from calculated pretense, and yet whatever it is in their brains that pushes them into drama and tantrums is very much guided by rational strategic considerations.
Only in the sense that a country with secure borders is hurting itself by forfeiting potential gains from trade. If what they want is to avoid being contaminated by your ideas, to avoid being criticized, that minefield is doing it's job just fine.