thomblake comments on Open Thread: August 2009 - Less Wrong

5 Post author: taw 01 August 2009 03:06PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (188)

You are viewing a single comment's thread. Show more comments above.

Comment author: thomblake 04 August 2009 08:20:05PM 2 points [-]

I think it's obvious which would be more right. But the real question is, which would be more prime?

Comment author: Yvain 04 August 2009 08:52:35PM *  3 points [-]

No, I'm asking which would be more right, and I don't think it's obvious.

If I like steak and you're a vegetarian, and I'm feeling altruistic according to normal human standards, which do I give you? Steak or vegetables?

My utility function contains a term that sort of resembles a desire to increase your utility function, which is why I'd probably give you vegetables. But intuitively I feel like this only works when your utility function is close enough to mine that I can at least sympathize with it. I honestly don't know what I'd do in the Pebble Sorter situation.

Comment author: thomblake 04 August 2009 09:08:35PM 0 points [-]

If I like steak and you're a vegetarian, and I'm feeling altruistic according to normal human standards, which do I give you? Steak or vegetables?

Well, if you want to do something that I would think was nice, then you give me whichever one I'd rather receive (presumably vegetables).

But are you concerned about what I would want, or what you would?

It's time to go teach those baby-eating pebblesorters right from wrong!

(I don't have any opinions about what to do for pebblesorters. Morality is about reality.)