nshepperd comments on Giving What We Can, 80,000 Hours, and Meta-Charity - Less Wrong

44 Post author: wdmacaskill 15 November 2012 08:34PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (182)

You are viewing a single comment's thread. Show more comments above.

Comment author: nshepperd 27 November 2012 06:22:38AM 3 points [-]

Yes, I've read it. I'm not entirely convinced that all values reduce to happiness, but I've never seen any value that can't be reduced to happiness. That's one of the areas in ethics where I'm the most uncertain. In practice, it doesn't come up much because in almost every situation, happiness and preference satisfaction amount to the same thing.

You can probably think of a happiness-based justification for any value someone throws at you. But that's probably only because you're coming from the privileged position of being a human who already knows those values are good, and hence wants to find a reason happiness justifies them. I suspect an AI designed only to maximise happiness would probably find a different way that would produce more happiness while disregarding almost all values we think we have.

Comment author: MTGandP 28 November 2012 06:40:02AM 1 point [-]

It's difficult for me to say because this sort of introspection is difficult, but I believe that I generally reject values when I find that they don't promote happiness.

You can probably think of a happiness-based justification for any value someone throws at you.

But some justifications are legitimate and some are rationalizations. With the examples of discovery and creativity, I think it's obvious that they increase happiness by a lot. It's not like I came up with some ad hoc justification for why they maybe provide a little bit of happiness. It's like discovery is responsible for almost all of the increases in quality of life that have taken place over the past several thousand years.

I suspect an AI designed only to maximise happiness would probably find a different way that would produce more happiness while disregarding almost all values we think we have.

I think a lot of our values do a very good job of increasing happiness, and I welcome an AI that can point out which values don't.

Comment author: nshepperd 28 November 2012 08:35:34AM *  3 points [-]

With the examples of discovery and creativity, I think it's obvious that they increase happiness by a lot.

The point is that's not sufficient. Like saying "all good is complexity, because for example a mother's love for her child is really complex". Yes, it's complex compared to some boring things like carving identical chair legs out of wood over and over for eternity, but compared to, say, tiling the universe with the digits of chaitin's omega or something, it's nothing. And tiling the universe with chaitin's omega would be a very boring and stupid thing to do.

You need to show that the value in question is the best way of generating happiness. Not just that it results in more than the status quo. It has to generate more happiness, than, say, putting everyone on heroine forever. Because otherwise someone who really cared about happiness would just do that.

I think a lot of our values do a very good job of increasing happiness, and I welcome an AI that can point out which values don't.

And they other point is that values aren't supposed to do a job. They're meant to describe what job you would like done! If you care about something that doesn't increase happiness, then self-modifying to lose that so as to make more happiness would be a mistake.

Comment author: MTGandP 29 November 2012 12:05:04AM *  0 points [-]

You need to show that the value in question is the best way of generating happiness.

You're absolutely correct. Discovery may not always be the best way of generating happiness; and if it's not, you should do something else.

And the other point is that values aren't supposed to do a job.

Not all values are terminal values. Some people value coffee because it wakes them up; they don't value coffee in itself. If they discover that coffee in fact doesn't wake them up, they should stop valuing coffee.

With the examples of discovery and creativity, I think it's obvious that they increase happiness by a lot.

The point is that's not sufficient.

What is sufficient is demonstrating that if discovery does not promote happiness then it is not valuable. As I explained in my sorting sand example, discovery that does not in any way promote happiness is not worthwhile.

Comment author: MugaSofer 27 November 2012 06:45:32AM 0 points [-]

Well, orgasmium, for a start.