Eugine_Nier comments on Rationality Quotes January 2013 - Less Wrong

6 Post author: katydee 02 January 2013 05:23PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (604)

You are viewing a single comment's thread. Show more comments above.

Comment author: MugaSofer 16 January 2013 02:40:32PM *  -2 points [-]

Interesting analogy. If we accept that utilities are additive, then there is presumably a number of sparrows worth killing for. (Of course, there may be a limit on all possible sparrows or sparrow utilities may be largely due to species preservation or something. As an ethics-based vegetarian, however, I can simply change it to "sparrows tortured.) I would be uncomfortable trying to put a number on it, what with the various sacred value conflicts involved, but I accept that a Friendly AI (even one Friendly only to me) would know and act on it.

Maslow's Pyramid is not intended as some sort of alternative to utilitarianism, it's a description of how we should prioritize the needs of humans. An imperfect one, of course, but better than nothing.

How sure? Based on what? What would persuade you otherwise?

Comment author: Eugine_Nier 17 January 2013 01:15:22AM 1 point [-]

If we accept that utilities are additive

Why?

Comment author: [deleted] 17 January 2013 01:51:22AM 1 point [-]

They almost certainly are on the margin (think taylor series approx of utility function). Get to the point where you are talking about killing a significant fraction of the sparrow population, then there's no reason to think so.

Comment author: Eugine_Nier 18 January 2013 04:34:19AM 2 points [-]

They almost certainly are on the margin

True, but this doesn't apply to MugaSofer's claim that

there is presumably a number of sparrows worth killing for.