Nick_Tarleton comments on Open Thread: August 2009 - Less Wrong

5 Post author: taw 01 August 2009 03:06PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (188)

You are viewing a single comment's thread. Show more comments above.

Comment author: gwern 01 August 2009 06:18:21PM 1 point [-]

A number of days ago I was arguing with AngryParsley about how to value future actions; I thought it was obvious one should maximize the total utility over all people the action affected, while he thought it equally self-evident that maximizing average utility was better still. When I went to look, I couldn't see any posts on LW or OB on this topic.

(I pointed out that this view would favor worlds ruled by a solitary, but happy, dictator over populous messy worlds whose average just happens to work out to be a little less than a dictator's might be; he pointed out that if total was all that mattered, we might wind up favoring worlds where everyone is just 2 utilons away from committing suicide.)

Have we really never discussed this topic?

Comment author: Nick_Tarleton 01 August 2009 06:23:06PM 4 points [-]
Comment author: gwern 01 August 2009 08:50:08PM 1 point [-]

Yeah, that doesn't surprise me. But the context of our discussion was certainly different! I had suggested to AngryParsley that even if we had next to no understanding of how to modify our minds for the better, uploading would still be useful since we could make 10 copies of ourselves with semi-random changes, and let only the best one propagate; he objected that how did I plan to get rid of the excess 9? By murder was plainly awfully immoral, and my suggestion of forcing them to live out the standard 4 score and 10 only somewhat less so - by not allowing them to be immortal or whatever the selected copy would get, I would be lowering the average. (Going by totals, this of course isn't an issue.)

Comment author: torekp 08 August 2009 03:59:50PM *  0 points [-]

The Mere Addition Paradox suffices to refute the AVG view. From Nick's link:

Scenario A contains a population in which everybody leads lives well worth living. In A+ there is one group of people as large as the group in A and with the same high quality of life. But A+ also contains a like number of people with a somewhat lower quality of life. In Parfit's terminology A+ is generated from A by “mere addition”. Comparing A and A+ it is reasonable to hold that A+ is better than A or, at least, not worse.

For example, A+ could evolve from A by the choice of some parents to have children whose quality of life is good, though not as good as the average in A. We can even suppose that this makes the parents a little happier, while still lowering the overall average.

Comment author: djcb 02 August 2009 11:53:44AM 0 points [-]

Thanks for the link.

And you are right, by Jove, these philosophers really like to go on about it -- ie.the whole issue could be summarized as the question whether we should optimize for AVG(good) or for SUM(good) -- and some variations. A question that ultimately cannot be answered. The length of the bibliography makes it almost comical.

Comment author: Psy-Kosh 03 August 2009 07:10:09AM 0 points [-]

The main problem I have with AVG is that it implies that as population increases, inherent value of each individual decreases. Why should you be suddenly less important simply because someone else was just born? (I don't mean the instrumental components of your value but your inherent value)