Stuart_Armstrong comments on Where do selfish values come from? - Less Wrong

27 Post author: Wei_Dai 18 November 2011 11:52PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (57)

You are viewing a single comment's thread. Show more comments above.

Comment author: Stuart_Armstrong 19 November 2011 12:58:19PM 1 point [-]

No, that's not the meaning I had in mind.

What is your meaning then? What would you call "caring about the welfare of a particular individual (that happens to be myself)"?

Comment author: Wei_Dai 19 November 2011 07:11:02PM 2 points [-]

Ok, I do mean:

caring about the welfare of a particular individual (that happens to be myself)

but I don't mean:

caring about welfare of a particular individual

(i.e., without the part in parenthesis) Does that clear it up?

Comment author: Vladimir_Nesov 19 November 2011 09:25:00PM *  1 point [-]

Do you mean that the agent itself must be the person it cares about? What if the agent is carried in a backpack (of the person in question), or works over the Internet?

What if the selfish agent that cares about itself writes an AI that cares about the agent, giving this AI more optimization power, since they share the same goal?

Comment author: Stuart_Armstrong 21 November 2011 10:33:41AM 0 points [-]

Ah, there was a slight confusion on my part. So if I'm reading this correctly you define formally selfish to mean... selfish. :-)