thomblake comments on Human values differ as much as values can differ - Less Wrong

13 Post author: PhilGoetz 03 May 2010 07:35PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (205)

You are viewing a single comment's thread. Show more comments above.

Comment author: thomblake 23 May 2012 01:58:15PM 6 points [-]

Any criticism of average utilitarianism that claims that it advocates killing unsatisfied people sounds like rigging the speedometer to me. Obviously what an average utilitarian means is "Work to increase people's utility, and measure this by looking at how high average utility is." Drawing bizarre implications like "kill unsatisfied people" from that is obviously an example of confusing the measurement method for the actual goal.

What an ethical theory like average utilitarianism is supposed to do, is give you a description of what constitutes a good state of affairs. Better states of affairs are defined to be those with higher average utility. If killing people increases average utility, and killing people is still wrong, then average utilitarianism is false.

When you're defining something rigorously, "you know what I mean" is not an acceptable answer. This is especially obvious in the case where we're trying to program machines to act ethically, but it's a failing of the theory even if that's not our goal.

Comment author: Ghatanathoah 23 May 2012 04:27:46PM -1 points [-]

When you're defining something rigorously, "you know what I mean" is not an acceptable answer. This is especially obvious in the case where we're trying to program machines to act ethically, but it's a failing of the theory even if that's not our goal.

You're right. An ethical theory is flawed if it is insufficiently rigorous. But it seems to me that if it's fairly obvious that a person means something other than a strictly literal interpretation of their theory the response should be to Steel-Man their argument. Say, "Your theory gives some insane-seeming results interpreted literally, but it seems to me that this is because you were insufficiently rigorous in stating it. Here's what I think you actually meant." That just seems like the charitable thing to do to me.

Comment author: thomblake 23 May 2012 05:08:03PM 1 point [-]

For reference, Steel Man is a different task than the principle of charity calls for. The charitable interpretation is the best interpretation you can reasonably make of someone's argument. The Steel Man is figuratively "the strongest thing you can construct out of its corpse" - it can include quite a bit that the author didn't intend or even would disagree with..

Comment author: TimS 23 May 2012 05:48:06PM 1 point [-]

To add a friendly addendum:

  • Reading a position charitably is polite

  • Making a Steel-Man of a position advances true understanding

This is just one of many examples of situations in which politeness potentially conflicts with seeking truth.