shminux comments on A (small) critique of total utilitarianism - Less Wrong

36 Post author: Stuart_Armstrong 26 June 2012 12:36PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (237)

You are viewing a single comment's thread. Show more comments above.

Comment author: shminux 26 June 2012 08:36:20PM 0 points [-]

Hedonistic utilitarianism ("what matters is the aggregate happiness") runs into the same repugnant conclusion.

Comment author: Lightwave 26 June 2012 08:48:26PM 0 points [-]

But this happens exactly because interpersonal (hedonistic) utility comparison is possible.

Comment author: shminux 26 June 2012 09:25:11PM 0 points [-]

Right, if you cannot compare utilities, you are safe from the repugnant conclusion.

On the other hand, this is not very useful instrumentally, as a functioning society necessarily requires arbitration of individual wants. Thus some utilities must be comparable, even if others might not be. Finding a boundary between the two runs into the standard problem of two nearly identical preferences being qualitatively different.

Comment author: Lukas_Gloor 26 June 2012 08:53:30PM -2 points [-]

Yes but it doesn't have the problem Vladimir_M described above, and it can bite the bullet in the repugnant conclusion by appealing to personal identity being an illusion. Total hedonistic utilitarianism is quite hard to argue against, actually.

Comment author: shminux 26 June 2012 09:43:30PM *  3 points [-]

As I mentioned in the other reply, I'm not sure how a society of total hedonistic utilitarians would function without running into the issue of nearly identical but incommensurate preferences.

Comment author: Lukas_Gloor 26 June 2012 10:28:23PM 0 points [-]

Hedonistic utilitarianism is not about preferences at all. It's about maximizing happiness, whatever the reason or substrate for it. The utilitronium shockwave would be the best scenario for total hedonistic utilitarianism.

Comment author: shminux 27 June 2012 01:18:12AM 0 points [-]

Maybe I misunderstand how total hedonistic utilitarianism works. Don't you ever construct an aggregate utility function?

Comment author: Lukas_Gloor 27 June 2012 01:56:01AM 0 points [-]

No, nothing of that sort. You just take the surplus of positive hedonic states over negative ones and try to maximize that. Interpersonal boundaries become irrelevant, in fact many hedonistic utilitarians think that the concept of personal identity is an illusion anyway. If you consider utility functions, then that's preference utilitarianism or something else entirely.

Comment author: shminux 27 June 2012 05:06:46PM 2 points [-]

You just take the surplus of positive hedonic states over negative ones and try to maximize that.

How is that not an aggregate utility function?

Comment author: Lukas_Gloor 27 June 2012 05:23:37PM 1 point [-]

Utilons aren't hedons. You have one simple utility function that states you should maximize happiness minus suffering. That's similar to maximizing paperclips, and it avoids the problems discussed above that preference utiltiarianism has, namely how interpersonally differing utility functions should be compared to each other.

Comment author: David_Gerard 29 June 2012 07:29:03AM 2 points [-]

You still seem to be claiming that (a) you can calculate a number for hedons (b) you can do arithmetic on this number. This seems problematic to me for the same reason as doing these things for utilons. How do you actually do (a) or (b)? What is the evidence that this works in practice?

Comment author: Lukas_Gloor 29 June 2012 02:53:25PM -2 points [-]

I don't claim that I, or anyone else, can do that right now. I'm saying there doesn't seem to be a fundamental reason why that would have to remain impossible forever. Why do you think it will remain impossible forever?

As for (b), I don't even see the problem. If (a) works, then you just do simple math after that. In case you're worried about torture and dust specks not working out, check out section VI of this paper.

And regarding (a), here's an example that approximates the kind of solutions we seek: In anti-depression drug tests, the groups with the actual drug and the control group have to fill out self-assessments of their subjective experiences, and at the same time their brain activity and behavior is observed. The self-reports correlate with the physical data.

Comment author: shminux 27 June 2012 10:10:40PM *  0 points [-]

Utilons aren't hedons.

Thanks for the link. I still cannot figure out why utilons are not convertible to hedons, and even if they aren't, why isn't a mixed utilon/hedon maximizer susceptible to dutch booking. Maybe I'll look through the logic again.

Comment author: CarlShulman 29 June 2012 05:12:17AM 1 point [-]

Hedonism doesn't specify what sorts of brain states and physical objects have how much pleasure. There are a bewildering variety of choices to be made in cashing out a rule to classify which systems are how "happy." Just to get started, how much pleasure is there when a computer running simulations of happy human brains is sliced in the ways discussed in this paper?

Comment author: Lukas_Gloor 29 June 2012 02:38:41PM 1 point [-]

But aren't those empirical difficulties, not fundamental ones? Don't you think there's a fact of the matter that will be discovered if we keep gaining more and more knowledge? Empirical problems can't bring down an ethical theory, but if you can show that there exists a fundamental weighting problem, then that would be valid criticism.

Comment author: CarlShulman 29 June 2012 06:06:27PM 5 points [-]

But aren't those empirical difficulties, not fundamental ones?

What sort of empirical fact would you discover that would resolve that? A detector for happiness radiation? The scenario in that paper is pretty well specified.