eli_sennesh comments on An overall schema for the friendly AI problems: self-referential convergence criteria - Less Wrong

17 Post author: Stuart_Armstrong 13 July 2015 03:34PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (110)

You are viewing a single comment's thread. Show more comments above.

Comment author: [deleted] 27 July 2015 03:53:40AM 0 points [-]

E.g. we (Westerners) generally no longer value honoring our ancestors (at least not many of them), even though it is a fairly independent value and roughly consistent with our other values. It is expensive to honor ancestors, and ancestors don't demand that we continue to maintain that value, so it receives less attention.

This sweeps the model-dependence of "values" under the rug. The reason we don't value honoring our ancestors is that we don't believe they continue to exist after death, and so we don't believe social relations of any kind can be carried on with them.

Comment author: CCC 27 July 2015 08:51:38AM *  0 points [-]

The reason we don't value honoring our ancestors is that we don't believe they continue to exist after death

This could be a case of typical mind fallacy. I can point to a number of statistical studies that show that a large number of Westerners claim that their ancestors do continue to exist after death.

Anyone who believes that some sort of heaven or hell exists.

And a lot of these people nonetheless don't accord their ancestors all that much in the way of honour...

Comment author: Jiro 27 July 2015 06:23:23PM 0 points [-]

I can point to a number of statistical studies that show that a large number of Westerners claim that their ancestors do continue to exist after death.

They may believe it, but they don't alieve it.

Comment author: Lumifer 27 July 2015 06:29:08PM 2 points [-]

How do you know?

Comment author: Jiro 27 July 2015 06:36:07PM *  0 points [-]

Because the things that people would do if they believed in and acted as though they believe in life after death are profoundly weird, and we don't see any of that around. Can you imagine the same people who say that the dead "went to a better place" being sad that someone has not died, for instance? (Unless they're suffering so much or causing so much suffering that death is preferable even without an afterlife.)

Comment author: Lumifer 27 July 2015 06:39:29PM 2 points [-]

Because the things that people would do if they believed in and acted as though they believe in life after death are profoundly weird, and we don't see any of that around.

I don't see why they need to be "profoundly weird". Remember, this subthread started with "honoring ancestors". The Chinese culture is probably the most obvious one where honoring ancestors is a big thing. What "profoundly weird" things does it involve?

Comment author: [deleted] 28 July 2015 12:30:52AM 0 points [-]

What "profoundly weird" things does it involve?

Given that this is the Chinese we're talking about, expecting one's ancestors to improve investment returns in return for a good sacrifice.

Comment author: Jiro 27 July 2015 06:53:25PM 0 points [-]

Sorry, I don't know enough about Chinese culture to answer. But I'd guess that either they do have weird beliefs (that I'm not familiar with so I can't name them), or they don't and honoring ancestors is an isolated thing they do as a ritual. (The answer may be different for different people, of course.)

Comment author: Lumifer 27 July 2015 06:55:33PM 1 point [-]

Speaking of "profoundly weird" things, does the veneration of saints in Catholicism qualify? :-)

Comment author: [deleted] 28 July 2015 12:31:50AM -1 points [-]

Insofar as anyone expects saints to perform the function of demigods and intervene causally with miracles on behalf of the person praying, yes, it is "profoundly weird" magical thinking.

Why do you ask a site full of atheists if they think religion is irrational?

Comment author: Lumifer 28 July 2015 01:03:17AM 1 point [-]

"Irrational" and "weird" are quite different adjectives.

Comment author: David_Bolin 28 July 2015 06:18:38AM 1 point [-]

You are assuming that human beings are much more altruistic than they actually are. If your wife has the chance of leaving you and having a much better life where you will never hear from her again, you will not be sad if she does not take the chance.

Comment author: CCC 28 July 2015 08:07:35AM 0 points [-]

Because the things that people would do if they believed in and acted as though they believe in life after death are profoundly weird

Okay, now I'm curious. What exactly do you think that people would do if they believed in life after death?

Comment author: Jiro 28 July 2015 02:39:43PM *  1 point [-]

-- Be happy that people have died and sad that they remain alive (same qualifiers as before: person is not suffering so much that even nothingness is preferable, etc.) and the reverse for people who they don't like

-- Want to kill people to benefit them (certainly, we could improve a lot of third world suffering by nuking places, if they have a bad life but a good afterlife. Note that the objection "their culture would die out" would not be true if there is an afterlife.)

-- In the case of people who oppose abortions because fetuses are people (which I expect overlaps highly with belief in life after death), be in favor of abortions if the fetus gets a good afterlife

-- Be less willing to kill their enemies the worse the enemy is

-- Do extensive scientific research trying to figure out what life after death is like.

-- Genuinely think that having their child die is no worse than having their child move away to a place where the child cannot contact them

-- Drastically reduce how bad they think death is when making public policy decisions; there would be still some effect because death is separation and things that cause death also cause suffering, but we act as though causing death makes some policy uniquely bad and preventing it uniquely good

-- Not oppose suicide

Edit: Support the death penalty as more humane than life imprisonment.

(Some of these might not apply if they believe in life after death but also in Hell, but that has its own bizarre consequences.)

Comment author: RichardKennaway 28 July 2015 04:32:43PM 2 points [-]

-- Be less willing to kill their enemies the worse the enemy is

Now might I do it pat. Now he is praying.
And now I’ll do ’t. And so he goes to heaven.
And so am I revenged.—That would be scanned.
A villain kills my father, and, for that,
I, his sole son, do this same villain send
To heaven.
Oh, this is hire and salary, not revenge.
He took my father grossly, full of bread,
With all his crimes broad blown, as flush as May.
And how his audit stands who knows save heaven?
But in our circumstance and course of thought
'Tis heavy with him. And am I then revenged
To take him in the purging of his soul
When he is fit and seasoned for his passage?
No.
Up, sword, and know thou a more horrid hent.
When he is drunk asleep, or in his rage,
Or in th' incestuous pleasure of his bed,
At game a-swearing, or about some act
That has no relish of salvation in ’t—
Then trip him, that his heels may kick at heaven,
And that his soul may be as damned and black
As hell, whereto it goes. My mother stays
This physic but prolongs thy sickly days.

-- Hamlet, Act 3, scene 3.

Comment author: RichardKennaway 28 July 2015 04:27:46PM 2 points [-]

In Christianity, we are as soldiers on duty who cannot desert their post. Suicide and murder are mortal sins, damning one to perdition hereafter. Christians differ on whether this is a causal connection: works -> fate, or predestined by grace: grace -> works and grace -> fate. Either way, the consequences of believing in the Christian conception of life after death add up to practicing Christian virtue in this life.

In Buddhism, you get reincarnated, but only if you have lived a virtuous life do you get a favorable rebirth. Killing, including of yourself, is one of the worst sins and guarantees you a good many aeons in the hell worlds. The consequences of believing in the Buddhist conception of life after death add up to practicing Buddhist virtue in this life.

In Islam, paradise awaits the virtuous and hell the wicked. The consequences of believing in the Islamic conception of life after death add up to practicing Islamic virtue in this life. We can observe these consequences in current affairs.

Comment author: Jiro 28 July 2015 04:36:12PM 0 points [-]

I don't think that helps. For instance, if they alieve in an afterlife but their religion says that suicide and murder are mortal sins, they won't actually commit murder or suicide, but they would still not think it was sad that someone died in the way we think it's sad, would not insist that public policies should reduce deaths, etc.

You would also expect a lot of people to start thinking of religious prohibitions on murder and suicide like many people think of religious prohibitions on homosexuality--If God really wants that, he's being a jerk and hurting people for no obvious reason. And you'd expect believers to simply rationalize away religious prohibitions on murder and suicide and say that they don't apply just like religious believers already do to lots of other religious teachings (of which I'm sure you can name your own examples).

Comment author: RichardKennaway 28 July 2015 04:45:17PM 0 points [-]

If God really wants that, he's being a jerk and hurting people for no obvious reason.

Ask a Christian and they'll give you reasons. Ask a Jew and they'll give you reasons, except for those among the laws that are to be obeyed because God says so, despite there not being a reason known to Man. Ask a Buddhist, ask a Moslem.

There is no low-hanging fruit here, no instant knock-down arguments against any of these faiths that their educated practitioners do not know already and have answers to.

Comment author: CCC 29 July 2015 09:18:35AM 1 point [-]

Be happy that people have died and sad that they remain alive (same qualifiers as before: person is not suffering so much that even nothingness is preferable, etc.) and the reverse for people who they don't like

Hmmm.

What is known is that people who go to the afterlife don't generally come back (or, at least, don't generally come back with their memories intact). Historical evidence strongly suggests that anyone who remains alive will eventually die... so remaining alive means you have more time to enjoy what is nice here before moving on.

So, I don't imagine this would be the case unless the afterlife is strongly known to be significantly better than here.

Want to kill people to benefit them (certainly, we could improve a lot of third world suffering by nuking places, if they have a bad life but a good afterlife. Note that the objection "their culture would die out" would not be true if there is an afterlife.)

Is it possible for people in the afterlife to have children? It may be that their culture will quickly run out of new members if they are all killed off. Again, though, this is only true if the afterlife is certain to be better than here.

In the case of people who oppose abortions because fetuses are people (which I expect overlaps highly with belief in life after death), be in favor of abortions if the fetus gets a good afterlife

Be less willing to kill their enemies the worse the enemy is

Both true if and only if the afterlife is known to be better.

Do extensive scientific research trying to figure out what life after death is like.

People have tried various experiments, like asking people who have undergone near-death experiences. However, there is very little data to work with and I know of no experiment that will actually give any sort of unambiguous result.

Genuinely think that having their child die is no worse than having their child move away to a place where the child cannot contact them

And where their child cannot contact anyone else who is still alive, either. Thrown into a strange and unfamiliar place with people who the parent knows nothing about. I can see that making parents nervous...

Drastically reduce how bad they think death is when making public policy decisions; there would be still some effect because death is separation and things that cause death also cause suffering, but we act as though causing death makes some policy uniquely bad and preventing it uniquely good

Exile is also generally considered uniquely bad; and since the dead have never been known to return, death is at the very least a form of exile that can never be revoked.

Not oppose suicide

...depends. Many people who believe in life after death also believe that suicide makes things very difficult for the victim there.

Support the death penalty as more humane than life imprisonment.

Again, this depends; if there is a Hell, then the death penalty kills a person without allowing him much of a chance to try to repent, and could therefore be seen as less humane than life imprisonment.

Comment author: Jiro 29 July 2015 02:11:34PM 1 point [-]

The worse the afterlife is, the more similar people's reactions will be to a world where there is no afterlife. In the limit, the afterlife is as bad as or worse than nonexistence and people would be as death-averse as they are now. Except that this is contrary to how people claim to think of the afterlife when they assert belief in it. The afterlife can't be good enough to be comforting and still bad enough not to lead to any of the conclusions I described. And this includes being bad for reasons such as being like exile, being irreversible, etc.

And I already said that if there is a Hell (a selectively bad afterlife), many of these won't apply, but the existence of Hell has its own problems.

Comment author: CCC 30 July 2015 08:42:14AM 1 point [-]

The worse the afterlife is, the more similar people's reactions will be to a world where there is no afterlife.

I'd phrase it as "the scarier the afterlife is, the more similar people's reactions will be to a world where there is no afterlife." The word "scarier" is important, because something can look scary but be harmless, or even beneficial.

And people's reactions do not depend on what the afterlife is like; they depend on what people think about the afterlife.

And one of the scariest things to do is to jump into a complete unknown... even if you're pretty sure it'll be harmless, or even beneficial, jumping into a complete unknown from which there is no way back is still pretty scary...

Comment author: [deleted] 28 July 2015 12:29:16AM *  -1 points [-]

I can point to a number of statistical studies that show that a large number of Westerners claim that their ancestors do continue to exist after death.

No, they believe-in-the-belief that their ancestors continue to exist after death. They rarely, and doubtingly, if ever, generate the concrete expectation that anything they can do puts them in causal contact with the ghosts of their ancestors, such that they would expect to see something different from their ancestors being permanently gone.