You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

metis comments on Torture vs Dust Specks Yet Again - Less Wrong Discussion

-2 Post author: sentientplatypus 20 August 2013 12:06PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (54)

You are viewing a single comment's thread.

Comment author: [deleted] 19 November 2013 01:39:06AM *  1 point [-]

blee

Comment author: TheOtherDave 19 November 2013 02:12:18AM 0 points [-]

OK.

Given two people A and B, and given a choice between A breaking ten bones and B breaking nine bones, you prefer A breaking ten bones if you're A (because you have empathy).
Yes?

Similarly, presumably if you're B, you prefer that B break nine bones, again because you have empathy.
Yes?

And in both of those cases you consider that the morally correct choice... an AI that arrives at a different answer is "unfriendly"/immoral.
Yes?

So, OK.
Some additional questions.

  1. If you are neither A nor B and are given that choice, which do you prefer? Which do you consider the morally correct choice?

  2. If you are A, and you have a choice between A breaking ten bones, B breaking nine bones, and letting B make the choice instead, which do you prefer? Which do you consider the morally correct choice? Does it affect your choice if you know that B shares your preferences and has empathy, and will therefore predictably choose ten broken bones for themselves?