TheOtherDave comments on Holden's Objection 1: Friendliness is dangerous - LessWrong

11 Post author: PhilGoetz 18 May 2012 12:48AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (428)

You are viewing a single comment's thread. Show more comments above.

Comment author: TheOtherDave 18 May 2012 06:10:43PM 0 points [-]

Sorry, I'm being unclear. Let me try again.
For simplicity, let us say that T(x) = TRUE if x is sufficiently moral to include in CEV, and FALSE otherwise. (I don't mean to posit that we've actually implemented such a test.)

I'm asking if you mean to distinguish between:
(1) CEV includes x where T(x) = TRUE and x is human, and
(2) CEV includes x where T(x) = TRUE

Comment author: TimS 18 May 2012 06:56:09PM 0 points [-]

I'm still not sure I understand the question. That said, there are two issues here.

First, I would expect CEV(Klingon) to output something if CEV(human) does, but I'm not aware of any actual species that I would expect CEV(non-human species) to output for. If such a species existed (i.e. CEV(dolphins) outputs a morality), I would advocate strongly for something very like equal rights between humans and dolphins.

But even in that circumstance, I would be very surprised if CEV(all dolphins & all humans) outputted something other than "Humans, do CEV(humanity). Dolphins, do CEV(dolphin)"

Of course, I don't expect CEV(all of humanity ever) to output because I reject moral realism.

Comment author: TheOtherDave 18 May 2012 07:07:27PM 0 points [-]

I think that answers my question. Thanks.