You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

OrphanWilde comments on Desires You're Not Thinking About at the Moment - Less Wrong Discussion

1 Post author: Ghatanathoah 20 February 2013 09:41AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (37)

You are viewing a single comment's thread. Show more comments above.

Comment author: OrphanWilde 20 February 2013 03:57:22PM 3 points [-]

The "People" argument, once you taboo "people", becomes pretty convoluted; it is to some extent the question of what constitutes a person which the "desires" perspective seeks to answer.

Additionally, if we treat "desires" as a qualitative rather than quantitative measure ("Has desires" rather than "How many desires"), one of your rejections goes away.

That said, I agree with a specific form of this argument, which is that "Desires experienced" isn't a good measure of moral standing, because it fails to add up to normality; it doesn't include everything we'd like to include, and it doesn't exclude everything we'd like to exclude.

Comment author: handoflixue 20 February 2013 08:14:14PM 2 points [-]

The "People" argument, once you taboo "people", becomes pretty convoluted; it is to some extent the question of what constitutes a person which the "desires" perspective seeks to answer.

If I cared about "desires" then I would expect to treat cats and dogs analogous to how I treat humans, and this is patently false if you observe my behavior. Clearly I value "humans", not "animals with desires". Defining human might be beyond me, but I still seem to know them when I see 'em.

Comment author: OrphanWilde 20 February 2013 09:05:08PM *  0 points [-]

Most of the time. Unfortunately a definition that works "most of the time" is wholly unworkable. Note that the "desire" definition arose out of the abortion debate.

Do not consider this an insistence that you provide a viable alternate, rather, an insistence that you provide one only if you find it to be a viable alternative.

Comment author: Elithrion 21 February 2013 12:41:55AM 0 points [-]

Most of the time. Unfortunately a definition that works "most of the time" is wholly unworkable.

I think general relativity is pretty workable despite working "most of the time".

Comment author: Ghatanathoah 20 February 2013 09:26:11PM 0 points [-]

this is patently false if you observe my behavior.

Unless you have an insanely low level of akrasia, I'd be wary of using your behavior as a guide to your values.

I would expect to treat cats and dogs analogous to how I treat humans, and this is patently false if you observe my behavior. Clearly I value "humans", not "animals with desires"

Not necessarily. If animals desire radically different things from humans then you'd treat them differently even if you valued their desires equally. I don't think dogs and cats animals have the same sort of complex desires humans do, they seem to value attention and food and disvalue pain, fear, and hunger. So as long as you don't actively mistreat animals you are probably respecting their desires.

If a dog walked up to you and demonstrated that it could read, write, and communicate with you, and seemed to have a genius level IQ, and expressed a desire to go to college and learn theoretical physics, wouldn't you treat it more like a human and less like a normal dog?

Comment author: handoflixue 20 February 2013 10:01:22PM 1 point [-]

Unless you have an insanely low level of akrasia, I'd be wary of using your behavior as a guide to your values.

I'm not saying "having desires" isn't a factor somewhere, but I'm not a vegetarian so clearly I don't mind killing animals. I have no de-facto objection to eating dog meat instead of cow meat, but I'd be appalled to eat human. As near as I can tell, this applies exclusively to humans. I strongly suspect I'd be bothered to eat a talking dog, but I suspect both the talking and non-talking dogs have a desire not to be my dinner. The pertinent difference there seems to be communication, not desire.

I'm fine calling the relevant trait "being human" since, in this reality, it's an accurate generalization. I'm fine being wrong in the counter-factual "Dog's Talk" reality, since I don't live there. If I ever find myself living in a world with beings that are both (!human AND !dinner), I'll re-evaluate what traits contribute. Until then, I have enough evidence to rule out "desire", and insufficient evidence to propose anything other than "human" as a replacement :)

Comment author: Sarokrae 20 February 2013 06:15:07PM 2 points [-]

I've heard a common argument post-tabooing-"people" to be "I care about things that are close in thing-space to me. "People" is just a word I use for algorithms that run like me." (This is pretty much how I function in a loose sense, actually)

Comment author: RomeoStevens 22 February 2013 04:42:30AM 0 points [-]

There is something I am having that I label "subjective experience." I value this thing in myself and others. That I can't completely specify it doesn't matter much, I can't fully specify most of my values.

Comment author: OrphanWilde 22 February 2013 02:34:16PM -1 points [-]

You can't even tell whether or not others have this thing that you label subjective experience. Are you sure you value it in others?

Comment author: RomeoStevens 22 February 2013 08:28:43PM 0 points [-]

The world in which I am the only being having a subjective experience and everyone else is a p-zombie is ridiculously unlikely.

Comment author: OrphanWilde 22 February 2013 09:09:01PM 0 points [-]

I didn't suggest you were the only one having a subjective experience. I suggested that what you -label- a subjective experience may not be experienced by others.

Are you seeing the same red I am? Maybe. That doesn't stop us from using a common label to refer to an objective phenomenon.

Similarly, whatever similarities you think you share with other people may be the product of a common label referring to an objective phenomenon, experienced subjectively differently. And that can include subjective existence. The qualities of subjective existence you value are not necessarily present in every possible subjective existence.

Comment author: RomeoStevens 22 February 2013 09:18:39PM 0 points [-]

And when it results in predictions of different futures I'll care.

Comment author: DanArmak 20 February 2013 08:13:23PM 0 points [-]

You shouldn't try to taboo "people". Actual human brains really do think in terms of the category "people". If the world changes and the category no longer carves it at its joints (say, if superhuman AI is developed), human brains will remain to some extent hardwired with their category of "people". The only answer to the question of what constitutes a person is to go look at how human brains pattern-match things to recognize persons, which is that they look and behave like humans.

Comment author: OrphanWilde 20 February 2013 09:09:42PM -1 points [-]

That kind of attitude is an extremely effective way of -preventing- you from developing superhuman AI, or at least the kind you'd -want- to develop. Your superhuman AI needs to know the difference between plucked chickens and Greek philosophers.

Comment author: DanArmak 21 February 2013 07:38:04PM 0 points [-]

I think I don't understand what you're saying.

If you try to formalize what "people" or "morally valuable agents" are - also known as tabooing the word "people" - then you run into problems with bad definitions that don't match your intuition and maybe think plucked chickens are people.

That's exactly why I'm arguing that you should not formalize or taboo "people", because it's not a natural category; it's something that is best defined by pointing to a human brain and saying "whatever the brain recognizes as people, that's people".

Comment author: OrphanWilde 21 February 2013 07:51:36PM 0 points [-]

Are you going to put a human brain in your superhuman AI so it can use it for a reference?

Comment author: DanArmak 21 February 2013 09:32:13PM 0 points [-]

I could if I had to. Or I could tell it to analyze some brains and remember the results.