Bakkot comments on Welcome to Less Wrong! (2012) - Less Wrong

25 Post author: orthonormal 26 December 2011 10:57PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (1430)

You are viewing a single comment's thread. Show more comments above.

Comment author: Bakkot 11 June 2012 02:48:01PM 1 point [-]

Eh, functioning is a very rough definition and we've got to that pretty quickly.

Yeah, but my point was that doing so is not actually useful because now we have to decide whether or not babies fit this criterion (and if this criterion is good), and we're inevitably going to do that by analogy and example if at all. I was trying to skip right to that step, but I suppose we did get there eventually.


If they do, then I can keep eating them happily enough; if they don't, I've got the dilemma as to whether to stop eating animals or start eating babies. [...] And it's not clear to me, without knowing what you mean by functioning, that pigs or cows are more intelligent than babies.

Pigs are smart. Pigs are very smart: they have complex personalities, developed rules of social interaction, intentional deception, object permanence, high ability to learn... given a few hours they can figure out how mirrors work and use them to see around or behind obstacles. The list goes on. (Even still, you would not be tempted to confuse them with people.) I'm pretty sure pigs are smarter than wolves, for example. Certainly, if you spend any time around them, pigs are "obviously" smarter than babies.

To my knowledge babies have none of those abilities, nor, indeed, many of the other characteristics of functioning people.

Regardless, I have no doubt that pigs are closer to functioning adult humans than babies are. You'd best give up pork. (Or do what I view as the reasonable thing and give up the idea that babies are people.)

I'd be interested in what standard of "functional" you might propose that newborns would meet, though. Perhaps give examples of things which seem close to to line, on either side? For example, do wolves seem to you like people? Should killing a wolf be considered a moral wrong on par with murder?


I have to ask, at this point: have you seriously considered the possibility that babies aren't people?


That depends on the nature of the script.

The script is as I described it. It's compiling an AI and then launching it. Here, I'll write it for you:

g++ SnazzyAI.cpp -o SnazzyAI && ./SnazzyAI

We are supposing that it's still on the first step, compilation. However, with no interaction on our part, it's going to finish compiling and begin running the sufficiently-advanced AI. Unless we interrupt it before compilation finishes, in which case it will not.


[...] when that happened infanticide became a sign of maladaptive behaviour. [...] People recognised a poor gambling strategy and wondered what was wrong with the person.

You seem to have gotten on something of a tangent here. I'm not sure why you're talking about maladaptive behaviors. I'm talking about immoral behaviors.

It is, for example, almost certainly maladaptive to allow all women to go into higher education and industry, because those correlate strongly with having fewer children and that causes serious problems. (Witness Japan circa now.) This is, as you put it, a poor gambling strategy. Does that imply it's immoral for society to allow women to be education? Do reasonable people look at people who support women's rights and wonder what's wrong with them? Of course not.

So no, maladaptive does not imply immoral. As such, I stand by my original point, which was that I don't think you would have invented a moral rule against infanticide if you weren't raised with one.

Comment author: MileyCyrus 11 June 2012 03:40:52PM 0 points [-]

Am I the only who bit the speciesist bullet?

It doesn't matter if a pig is smarter than a baby. It wouldn't matter if a pig passed the Turing test. Babies are humans, so they get preferential treatment.

Comment author: Bakkot 12 June 2012 12:00:15AM 1 point [-]

Am I the only who bit the speciesist bullet?

As far as I remember, yes. (This thread has some 522 comments, so I hope you'll forgive my not reviewing all of them.)

For my part, at least, I read too much Asimov growing up to consider giving humans preference among all intelligences. Anyway, "species" isn't a hard-edged category built in to nature - do you get less and less preferential treatment as you become less and less human? (Perfectly reasonable, of course, I'm just wondering.)

Also, what's the standard against which beings are compared to determine how "human" they are? Phenotypically average among the current population? Nasty prospects for the cryonics advocates among us. And the mind-uploading camp. Also veers dangerously close to negative eugenics, if you're going to start declaring some people are less human than others.

Comment author: Strange7 12 June 2012 01:55:23AM 1 point [-]

do you get less and less preferential treatment as you become less and less human?

I'd say so, yeah. It's kind of a tricky function, though, since there are two reasons I'm logically willing to give preferential treatment to an organism: likelyhood of said organism eventually becoming the ancestor of a creature similar to myself, and likelyhood of that creature or it's descendants contributing to an environment in which creatures similar to myself would thrive.

Comment author: MileyCyrus 12 June 2012 02:51:04PM 0 points [-]

Anyway, "species" isn't a hard-edged category built in to nature - do you get less and less preferential treatment as you become less and less human?

It's a lot more hard-edged than intelligence. Of all the animals (I'm talking about individual animals, not species) in the world, practically all are really close to 0% or 100% human. On the other hand, there is a broad range of intelligence among animals, and even in humans. So if you want a standard that draws a clean line, humanity is better than intelligence.

Also, what's the standard against which beings are compared to determine how "human" they are? Phenotypically average among the current population? Nasty prospects for the cryonics advocates among us. And the mind-uploading camp.

I can tell the difference between an uploaded/frozen human, and a pig. Even a uploaded/frozen pig. Transhumans are in the preferential treatment category, but transpigs aren't..

Also veers dangerously close to negative eugenics, if you're going to start declaring some people are less human than others.

This is a fully general counter-argument. Any standard of moral worth will have certain objects that meet the standard and certain objects that fail. If you say "All objects that have X property have moral worth", I can immediately accuse you of eugenics against objects that do not have X property.

And a question for you :If you think that more intelligence equals more moral worth, does that mean that AI superintelligences have super moral worth? If existed, would you try and maximize the number of paperclips in order to satisfy the wants a superior intelligence?

Comment author: Bakkot 14 June 2012 04:00:41AM 0 points [-]

So if you want a standard that draws a clean line, humanity is better than intelligence.

It was a question, not an objection, one which you didn't quite answer. Do you get less and less preferential treatment as you become less and less human?

Transhumans are in the preferential treatment category, but transpigs aren't.

Again, this was a question, not an objection, and again you didn't quite answer the question. What's the standard against which beings are compared to determine how "human" they are? In what sense are uploaded humans still humans?

Also, I'll believe you can tell the difference between an uploaded adult human and an uploaded pig, at least given five minutes' conversation, but I'm much less certain you could tell the difference between an uploaded pig and an uploaded baby.

This is a fully general counter-argument.

Not quite the way I meant it. My objection is this: I'm OK with beings being treated less well because they are less people. I'm not OK with people being treated less well because they are less human. In particular, the prospect that we might both agree something is completely a person but you might think it deserves less moral weight because it isn't human is, frankly, scary - especially because we might disagree on whether or not it is human, even without disagreeing about whether or not it's a person.

Comment author: TimS 11 June 2012 03:03:15PM 0 points [-]

I really like your point about the distinction between maladaptive behavior and immoral behavior. But I don't think your example about women in higher education is as cut and dried as you present it.

Comment author: Bakkot 12 June 2012 12:08:10AM 0 points [-]

Agreed. (Nor is it written quite as clearly as it could be.) It was just the first thing that came to mind - I've been reading about Japan's current population problems. Hopefully it's adequate to convince readers that maladaptive isn't obviously equivalent to immoral, though.

Comment author: TimS 12 June 2012 12:53:14AM 0 points [-]

For those who think that morality is the godshatter of evolution, maladaptive is practically the definition of immoral. For me, maladaptive-ness is the explanation for why certain possible moral memes (insert society-wide incest-marriage example) don't exist in recorded history, even though I should otherwise expect them to exist given my belief in moral anti-realism.

Comment author: CuSithBell 12 June 2012 01:01:32AM *  1 point [-]

For those who think that morality is the godshatter of evolution, maladaptive is practically the definition of immoral.

Disagree? What do you mean by this?

Edit: If I believe that morality, either descriptively or prescriptively, consists of the values imparted to humans by the evolutionary process, I have no need to adhere to the process roughly used to select these values rather than the values themselves when they are maladaptive.

Comment author: TimS 12 June 2012 02:06:34AM 0 points [-]

If one is committed to a theory that says morality is objective (aka moral realism), one needs to point at what it is that make morality objectively true. Obvious candidates include God and the laws of physics. But those two candidates have been disproved by the empiricism (aka the scientific method).

At this point, some detritus of evolution starts to look like a good candidate for the source of morality. There isn't an Evolution Fairy who commanded the humans evolve to be moral, but evolution has created drives and preferences within us all (like hunger or desire for sex). More on this point here - the source of my reference to godshatter.

It might be that there is an optimal way of bringing these various drives into balance, and the correct choices to all moral decisions can be derived from this optimal path. As far as I can tell, those who are trying to derive morality from evo. psych endorse this position.

In short, if morality is the product of human drives created by evolution, then behavior that is maladaptive (i.e. counter to what is selected for by evolution) is by essentially correlated with immoral behavior.

That said, my summary of the position may be a bit thin, because I'm a moral anti-realist and don't believe the evo. psych -> morality story.

Comment author: CuSithBell 12 June 2012 03:33:31AM 2 points [-]

Ah, I see what you mean. I don't think one has to believe in objective morality as such to agree that "morality is the godshatter of evolution". Moreover, I think it's pretty key to the "godshatter" notion that our values have diverged from evolution's "value", and we now value things "for their own sake" rather than for their benefit to fitness. As such, I would say that the "godshatter" notion opposes the idea that "maladaptive is practically the definition of immoral", even if there is something of a correlation between evolutionarily-selectable adaptive ideas and morality.

Comment author: Estarlio 14 June 2012 02:06:07AM 0 points [-]

Regardless, I have no doubt that pigs are closer to functioning adult humans than babies are. You'd best give up pork.

I suppose I had, yes. It never really occurred to me that they might be that intelligent - but, yeah, having done a bit of reading they seem smart enough that I probably oughtn’t to eat them.

I'd be interested in what standard of "functional" you might propose that newborns would meet, though. Perhaps give examples of things which seem close to to line, on either side? For example, do wolves seem to you like people? Should killing a wolf be considered a moral wrong on par with murder?

Wolves definitely seem like people to me, yes. Adult humans are definitely on the list and wolves do pack behaviours which are very human-like. Killing a wolf for no good reason should be considered a moral wrong on par with murder. There's not to say that I think it should result in legal punishment on par with killing a human, mind, it's easier to work out that humans are people than it is to work out that wolves are - it's a reasonable mistake.

Insects like wasps and flies don't seem like people. Red pandas do. Dolphins do. Cows... don't. But given what I've discovered about pigs that bears some checking --- and now cows do. Hnn. Damn it, now I won't be able to look at burgers without feeling sad.

All the videos with loads of blood and the like never bothered me, but learning that food-animals are that intelligent really does.

Have you imagined what life would be like if you were stupider, or were more intelligent but denied a body with which that intelligence was easy to express? If your person-hood is fundamental to your identity, then as long as you can imagine being stupider and still being you that still qualifies as a person. In terms of how old a person would be to have the sort of capabilities the person you're imaging would have, at what point does your ability to empathise with the imaginary-you break down?


I have to ask, at this point: have you seriously considered the possibility that babies aren't people?

As far as I know how, yes. If you've got some ways of thinking that we haven't been talking about here, feel free to post them and I'll do my best to run them.

If Babies weren't people the world would be less horrifying. Just as if food-animals are people the world is more horrifying. But it would look the same in terms of behaviours - people kill people all the time, I don't expect them not to without other criteria being involved.


We are supposing that it's still on the first step, compilation. However, with no interaction on our part, it's going to finish compiling and begin running the sufficiently-advanced AI. Unless we interrupt it before compilation finishes, in which case it will not.

Not a person.


It is, for example, almost certainly maladaptive to allow all women to go into higher education and industry, because those correlate strongly with having fewer children and that causes serious problems. (Witness Japan circa now.) This is, as you put it, a poor gambling strategy. Does that imply it's immoral for society to allow women to be educated? Do reasonable people look at people who support women's rights and wonder what's wrong with them? Of course not.

No, because we've had that discussion. But people did and that attitude towards women was especially prevalent in Japan, where it was among the most maladaptive for the contrary to hold, until quite recently. Back in the 70s and 80s the idea for women was basically to get a good education and marry the person their family picked for them. Even today people who say they don't want children or a relationship are looked on as rather weird and much of the power there, in practice, works in terms of family relationships.

It just so happens there are lots of adaptive reasons to have precedents that seem to extend to cover women too. I don't think one can seriously forward an argument that keeps women at home and doesn't create something that can be used against him in fairly horrifying ways. Even if you don't have a fairly inclusive definition of people, it seems unwise to treat other humans in that way - you, after all, are the other human to another human.

Comment author: Bakkot 14 June 2012 04:36:05AM *  0 points [-]

I suppose I had, yes.

Upvoted.


Wolves definitely seem like people to me, yes.

Huh. I admit, this was not the response I was expecting.

Insects like wasps and flies don't seem like people. Red pandas do. Dolphins do.

What about fish? I'm pretty sure many fish are significantly more functional than one-month-old humans, possibly up to two or three months. (Younger than that I don't think babies exhibit the ability to anticipate things. Haven't actually looked this up anywhere reputable, though.) Also, separately, would you say that babies are around the lowest level of functioning that you can possess and still qualify as a person?

Trying to narrow down where we differ here: what signs of being-a-person does a one-month-old infant display that, say, Cleverbot does not?


Have you imagined what life would be like if you were stupider, or were more intelligent but denied a body with which that intelligence was easy to express?

Frequently. It's scary. But if I were in a body in which intelligence was not easy to express, and I was killed by someone who didn't think I was sufficiently functional to be a person, that would be a tragic accident, not a moral wrong.

In terms of how old a person would be to have the sort of capabilities the person you're imaging would have, at what point does your ability to empathise with the imaginary-you break down?

About age four, possibly a year or two earlier. I'm reasonably confident I had introspection at age four; I don't think I did much before that. I find myself completely unable to empathize with a 'me' lacking introspection.


As far as I know how, yes.

I am afraid that this might come off as condescending; know that no condescension is felt. :

I really like that in this community, and in this discussion in particular, this question can be asked and answered honestly and seriously. Thank you.

(Data point: I would not have asked if I had known you consider wolves to be people.)


It's compiling an AI and then launching it.

Not a person.

OK. So the point of this analogy is that newborns seem a lot like the script described, on the compilation step. Yes, they're going to develop advanced, functioning behaviors eventually, but no, they don't have them yet. They're just developing the infrastructure which will eventually support those behaviors.


Even today people who say they don't want children or a relationship are looked on as rather weird

Yes. (Holds outside of Japan as well.) It is, arguably, maladaptive. But it's certainly not immoral, no?

Admittedly the analogy is poor. You're right to point that out, and I'm not going to try to support it. However, thanks to the ensuing discussion, I know the question I actually want to ask: do you think behaviors are immoral if and only if they're maladaptive?

Comment author: Estarlio 17 June 2012 10:50:31AM -1 points [-]

What about fish? I'm pretty sure many fish are significantly more functional than one-month-old humans, possibly up to two or three months. (Younger than that I don't think babies exhibit the ability to anticipate things. Haven't actually looked this up anywhere reputable, though.)

I don't know enough about them - given they're so different to us in terms of gross biology I imagine it's often going to be quite difficult to distinguish between functioning and instinct - this:

http://news.bbc.co.uk/1/hi/england/west_yorkshire/3189941.stm

Says that scientists observed some of them using tools, and that definitely seems like people though.

Also, separately, would you say that babies are around the lowest level of functioning that you can possess and still qualify as a person?

Yes.

Trying to narrow down where we differ here: what signs of being-a-person does a one-month-old infant display that, say, Cleverbot does not?

Shared attention, recognition, prediction, bonding -


Frequently. It's scary. But if I were in a body in which intelligence was not easy to express, and I was killed by someone who didn't think I was sufficiently functional to be a person, that would be a tragic accident, not a moral wrong.

The legal definition of an accident is an unforeseeable event. I don't agree with that entirely because, well everything's foreseeable to an arbitrary degree of probability given the right assumptions. However, do you think that people have a duty to avoid accidents that they foresee a high probability-adjusted harm from? (i.e. the potential harm modified by the probability they foresee of the event.)

The thought here being that, if there's much room for doubt, there's so much suffering involved in killing and eating animals that we shouldn't do it even if we only argue ourselves to some low probability of their being people.

About age four, possibly a year or two earlier. I'm reasonably confident I had introspection at age four; I don't think I did much before that. I find myself completely unable to empathize with a 'me' lacking introspection.

Do you think that the use of language and play to portray and discuss fantasy worlds is a sign of introspection?


OK. So the point of this analogy is that newborns seem a lot like the script described, on the compilation step. Yes, they're going to develop advanced, functioning behaviors eventually, but no, they don't have them yet. They're just developing the infrastructure which will eventually support those behaviors.

I agree, if it doesn't have the capabilities that will make it a person there's no harm in stopping it before it gets there. If you prevent an egg and a sperm combining and implanting, you haven't killed a human.


I know the question I actually want to ask: do you think behaviors are immoral if and only if they're maladaptive?

No, fitness is too complex a phenomena for our relatively inefficient ways of thinking and feeling to update on it very well. If we fix immediate lethal response from the majority as one end of the moral spectrum, and enthusiastic endorsement as the other, then maladaptive behaviour tends to move you further towards the lethal response end of things. But we're not rational fitness maximisers, we just tend that way on the more readily apparent issues.