jdinkum comments on People v Paper clips - Less Wrong

-1 Post author: jdinkum 21 May 2012 04:06PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (20)

You are viewing a single comment's thread. Show more comments above.

Comment author: jdinkum 22 May 2012 03:16:28PM 1 point [-]

That's one element in what started my line of thought..I was imagining situations where I would consider the exchange of human lives for non-human objects. How many people's lives would be a fair exchange for a pod of bottlenose dolphins? A West Virginia mountaintop? An entire species of snail?

I think what I'm getting towards is there's a difference between human preferences and human preference for other humans. And by human preferences, I mean my own.

Comment author: [deleted] 22 May 2012 04:28:57PM 2 points [-]

I think what I'm getting towards is there's a difference between human preferences and human preference for other humans. And by human preferences, I mean my own.

That is one objection to Coherent Extrapolated Volition (CEV), i.e. that human values are too diverse. Though the space of possible futures that an AGI could spit out is VERY large compared to the space of futures people would want, even if one takes into consideration the diversity of human values.