You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

DanArmak comments on Desires You're Not Thinking About at the Moment - Less Wrong Discussion

1 Post author: Ghatanathoah 20 February 2013 09:41AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (37)

You are viewing a single comment's thread. Show more comments above.

Comment author: DanArmak 21 February 2013 07:38:04PM 0 points [-]

I think I don't understand what you're saying.

If you try to formalize what "people" or "morally valuable agents" are - also known as tabooing the word "people" - then you run into problems with bad definitions that don't match your intuition and maybe think plucked chickens are people.

That's exactly why I'm arguing that you should not formalize or taboo "people", because it's not a natural category; it's something that is best defined by pointing to a human brain and saying "whatever the brain recognizes as people, that's people".

Comment author: OrphanWilde 21 February 2013 07:51:36PM 0 points [-]

Are you going to put a human brain in your superhuman AI so it can use it for a reference?

Comment author: DanArmak 21 February 2013 09:32:13PM 0 points [-]

I could if I had to. Or I could tell it to analyze some brains and remember the results.