TimS comments on Welcome to Less Wrong! (2012) - Less Wrong

25 Post author: orthonormal 26 December 2011 10:57PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (1430)

You are viewing a single comment's thread. Show more comments above.

Comment author: Estarlio 09 June 2012 03:43:57AM -1 points [-]

I can come up with a rough definition, but rough definitions fail in exactly those cases where there is potential disagreement.

Eh, functioning is a very rough definition and we've got to that pretty quickly.


So will we rather say that we include mentally disabled humans above a certain level of functioning? The problem then is that babies almost certainly fall well below that threshold, wherever you might set it.

Well, the question is whether food animals fall beneath the level of babies. If they do, then I can keep eating them happily enough; if they don't, I've got the dilemma as to whether to stop eating animals or start eating babies.

And it's not clear to me, without knowing what you mean by functioning, that pigs or cows are more intelligent than babies. I've not seen one do anything like that. Predatory animals - wolves and the like, on the other tentacle, are obviously more intelligent than a baby.

As to how I'd resolve the dilemma if it did occur, I'm leaning more towards stopping eating food animals than starting to eat babies. Despite the fact that food animals are really tasty, I don't want to put a precedent in place that might get me eaten at some point.


I assume you've granted that sufficiently advanced AIs ought to be counted as people.

By fiat - sufficiently advanced for what? But I suppose I'll grant any AI that can pass the Turing test qualifies, yes.

Am I killing a person if I terminate this script before compilation completes? That is, does "software which will compile and run an AI" belong to the "people" or the "not people" group?

That depends on the nature of the script. If it's just performing some relatively simple task over and over, then I'm inclined to agree that it belongs in the not people group. If it is itself as smart as, say, a wolf, then I'm inclined to think it belongs in the people group.


Really? It seems to me that someone did invent the taboo[1] on, say, slavery.

I suppose, what I really mean to say is they're taboos because that taboo has some desirable effect on society.

The point I'm trying to make here is that if you started with your current set of rules minus the rule about "don't rape people" (not to say your hypothetical morals view it as acceptable, merely undecided), I think you could quite naturally come to conclude that rape was wrong. But it seems to me that this would not be the case if instead you left out the rule about "don't kill babies".

It seems to me that babies are quite valuable, and became so as their survival probability went up. In the olden days infanticide was relatively common - as was death in childbirth. People had a far more casual attitude towards the whole thing.

But as the survival probability went up the investment people made, and were expected to make, in individual children went up - and when that happened infanticide became a sign of maladaptive behaviour.

Though I doubt they'd have put it in these terms: People recognised a poor gambling strategy and wondered what was wrong with the person.

And I think it would be the same in any advanced society.

Comment author: Bakkot 11 June 2012 02:48:01PM 1 point [-]

Eh, functioning is a very rough definition and we've got to that pretty quickly.

Yeah, but my point was that doing so is not actually useful because now we have to decide whether or not babies fit this criterion (and if this criterion is good), and we're inevitably going to do that by analogy and example if at all. I was trying to skip right to that step, but I suppose we did get there eventually.


If they do, then I can keep eating them happily enough; if they don't, I've got the dilemma as to whether to stop eating animals or start eating babies. [...] And it's not clear to me, without knowing what you mean by functioning, that pigs or cows are more intelligent than babies.

Pigs are smart. Pigs are very smart: they have complex personalities, developed rules of social interaction, intentional deception, object permanence, high ability to learn... given a few hours they can figure out how mirrors work and use them to see around or behind obstacles. The list goes on. (Even still, you would not be tempted to confuse them with people.) I'm pretty sure pigs are smarter than wolves, for example. Certainly, if you spend any time around them, pigs are "obviously" smarter than babies.

To my knowledge babies have none of those abilities, nor, indeed, many of the other characteristics of functioning people.

Regardless, I have no doubt that pigs are closer to functioning adult humans than babies are. You'd best give up pork. (Or do what I view as the reasonable thing and give up the idea that babies are people.)

I'd be interested in what standard of "functional" you might propose that newborns would meet, though. Perhaps give examples of things which seem close to to line, on either side? For example, do wolves seem to you like people? Should killing a wolf be considered a moral wrong on par with murder?


I have to ask, at this point: have you seriously considered the possibility that babies aren't people?


That depends on the nature of the script.

The script is as I described it. It's compiling an AI and then launching it. Here, I'll write it for you:

g++ SnazzyAI.cpp -o SnazzyAI && ./SnazzyAI

We are supposing that it's still on the first step, compilation. However, with no interaction on our part, it's going to finish compiling and begin running the sufficiently-advanced AI. Unless we interrupt it before compilation finishes, in which case it will not.


[...] when that happened infanticide became a sign of maladaptive behaviour. [...] People recognised a poor gambling strategy and wondered what was wrong with the person.

You seem to have gotten on something of a tangent here. I'm not sure why you're talking about maladaptive behaviors. I'm talking about immoral behaviors.

It is, for example, almost certainly maladaptive to allow all women to go into higher education and industry, because those correlate strongly with having fewer children and that causes serious problems. (Witness Japan circa now.) This is, as you put it, a poor gambling strategy. Does that imply it's immoral for society to allow women to be education? Do reasonable people look at people who support women's rights and wonder what's wrong with them? Of course not.

So no, maladaptive does not imply immoral. As such, I stand by my original point, which was that I don't think you would have invented a moral rule against infanticide if you weren't raised with one.

Comment author: TimS 11 June 2012 03:03:15PM 0 points [-]

I really like your point about the distinction between maladaptive behavior and immoral behavior. But I don't think your example about women in higher education is as cut and dried as you present it.

Comment author: Bakkot 12 June 2012 12:08:10AM 0 points [-]

Agreed. (Nor is it written quite as clearly as it could be.) It was just the first thing that came to mind - I've been reading about Japan's current population problems. Hopefully it's adequate to convince readers that maladaptive isn't obviously equivalent to immoral, though.

Comment author: TimS 12 June 2012 12:53:14AM 0 points [-]

For those who think that morality is the godshatter of evolution, maladaptive is practically the definition of immoral. For me, maladaptive-ness is the explanation for why certain possible moral memes (insert society-wide incest-marriage example) don't exist in recorded history, even though I should otherwise expect them to exist given my belief in moral anti-realism.

Comment author: CuSithBell 12 June 2012 01:01:32AM *  1 point [-]

For those who think that morality is the godshatter of evolution, maladaptive is practically the definition of immoral.

Disagree? What do you mean by this?

Edit: If I believe that morality, either descriptively or prescriptively, consists of the values imparted to humans by the evolutionary process, I have no need to adhere to the process roughly used to select these values rather than the values themselves when they are maladaptive.

Comment author: TimS 12 June 2012 02:06:34AM 0 points [-]

If one is committed to a theory that says morality is objective (aka moral realism), one needs to point at what it is that make morality objectively true. Obvious candidates include God and the laws of physics. But those two candidates have been disproved by the empiricism (aka the scientific method).

At this point, some detritus of evolution starts to look like a good candidate for the source of morality. There isn't an Evolution Fairy who commanded the humans evolve to be moral, but evolution has created drives and preferences within us all (like hunger or desire for sex). More on this point here - the source of my reference to godshatter.

It might be that there is an optimal way of bringing these various drives into balance, and the correct choices to all moral decisions can be derived from this optimal path. As far as I can tell, those who are trying to derive morality from evo. psych endorse this position.

In short, if morality is the product of human drives created by evolution, then behavior that is maladaptive (i.e. counter to what is selected for by evolution) is by essentially correlated with immoral behavior.

That said, my summary of the position may be a bit thin, because I'm a moral anti-realist and don't believe the evo. psych -> morality story.

Comment author: CuSithBell 12 June 2012 03:33:31AM 2 points [-]

Ah, I see what you mean. I don't think one has to believe in objective morality as such to agree that "morality is the godshatter of evolution". Moreover, I think it's pretty key to the "godshatter" notion that our values have diverged from evolution's "value", and we now value things "for their own sake" rather than for their benefit to fitness. As such, I would say that the "godshatter" notion opposes the idea that "maladaptive is practically the definition of immoral", even if there is something of a correlation between evolutionarily-selectable adaptive ideas and morality.