Eugine_Nier comments on How Much Rent - Less Wrong

8 [deleted] 25 October 2011 07:53PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (49)

You are viewing a single comment's thread. Show more comments above.

Comment author: Eugine_Nier 26 October 2011 04:35:27AM 1 point [-]

I think you're using a non-standard definition of 'malicious'.

Comment author: wedrifid 26 October 2011 05:30:12AM 1 point [-]

He isn't. "Desire to do harm to another". This is distinct from callous indifference.

Comment author: Eugine_Nier 26 October 2011 06:28:21AM 1 point [-]

In that case the word arguably can't be applied to people either, as Eliezer pointed out in this post. The only time people actively "desire to harm another" is when (they believe that) they are punishing the other according to what we would call TDT/UDT. Of course, the same motive applies to an AI even one whose terminal goals are indifferent to humans.

Comment author: wedrifid 26 October 2011 06:37:54AM *  1 point [-]

In that case the word arguably can't be applied to people either, as Eliezer pointed out in this post.

Yes, it can. People really are malicious sometimes. That we are biased to attribute malice to enemies even when none is present does not rule out malice existing in people.

The only time people actively "desire to harm another" is when (they believe that) they are punishing the other according to what we would call TDT/UDT.

That just isn't true. And even if it were the fact that a TDT or UDT agent may do a similar action does not mean that a person is not feeling malice.

Of course, the same motive applies to an AI even one whose terminal goals are indifferent to humans.

Yes, not that they would need to apply that reasoning with humans. You don't need to punish people when you can just consume them as resources.