Nick_Tarleton comments on Open Thread: August 2009 - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (188)
A number of days ago I was arguing with AngryParsley about how to value future actions; I thought it was obvious one should maximize the total utility over all people the action affected, while he thought it equally self-evident that maximizing average utility was better still. When I went to look, I couldn't see any posts on LW or OB on this topic.
(I pointed out that this view would favor worlds ruled by a solitary, but happy, dictator over populous messy worlds whose average just happens to work out to be a little less than a dictator's might be; he pointed out that if total was all that mattered, we might wind up favoring worlds where everyone is just 2 utilons away from committing suicide.)
Have we really never discussed this topic?
Not really, but moral philosophers already have, at length.
Yeah, that doesn't surprise me. But the context of our discussion was certainly different! I had suggested to AngryParsley that even if we had next to no understanding of how to modify our minds for the better, uploading would still be useful since we could make 10 copies of ourselves with semi-random changes, and let only the best one propagate; he objected that how did I plan to get rid of the excess 9? By murder was plainly awfully immoral, and my suggestion of forcing them to live out the standard 4 score and 10 only somewhat less so - by not allowing them to be immortal or whatever the selected copy would get, I would be lowering the average. (Going by totals, this of course isn't an issue.)
The Mere Addition Paradox suffices to refute the AVG view. From Nick's link:
For example, A+ could evolve from A by the choice of some parents to have children whose quality of life is good, though not as good as the average in A. We can even suppose that this makes the parents a little happier, while still lowering the overall average.
Thanks for the link.
And you are right, by Jove, these philosophers really like to go on about it -- ie.the whole issue could be summarized as the question whether we should optimize for AVG(good) or for SUM(good) -- and some variations. A question that ultimately cannot be answered. The length of the bibliography makes it almost comical.
The main problem I have with AVG is that it implies that as population increases, inherent value of each individual decreases. Why should you be suddenly less important simply because someone else was just born? (I don't mean the instrumental components of your value but your inherent value)