thomblake comments on Only humans can have human values - Less Wrong

34 Post author: PhilGoetz 26 April 2010 06:57PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (159)

You are viewing a single comment's thread. Show more comments above.

Comment author: Matt_Simpson 27 April 2010 02:09:04PM *  4 points [-]

First of all, good post.

My main response is, aren't we running on hostile hardware? I am not the entire system called "Matt Simpson." I am a program, or a particular set of programs, running on the system called "Matt Simpson." This system runs lots of other programs. Some, like automatically pulling my hand away after I touch a hot stove, happen to achieve my values. Others, like running from or attacking anything that vaguely resembles a snake, are a minor annoyance. Still others, like the system wanting to violently attack other males, work directly counter to my values.

The hard problem of ethics - determining what our values actually are - is (partially?) reduced to determining which parts of the system are me. Which is still a hard problem. (Despite my language, I don't really think this is an identity problem)

Comment author: thomblake 27 April 2010 02:18:23PM 5 points [-]

Agreed, and a lot of the disputes in this realm come from people drawing identity in different ways. I submit that I am the entire system called "Thom Blake" as well as a bunch of other stuff like my smartphone and car.

Once you give up Platonic identity (or the immortal soul) you also get to have much fuzzier boundaries. A dualist who thinks "I am my mind" cannot imagine losing a part of oneself without "no longer being me", and thinks that cutting off one's hand has no impact on "who I really am". I think that cutting off my hand will have a great impact on me, in terms of my self and my identity, and cutting off my right hand less so than my left.