MixedNuts comments on Ego syntonic thoughts and values - Less Wrong

53 Post author: Yvain 17 July 2011 08:43PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (53)

You are viewing a single comment's thread.

Comment author: MixedNuts 13 July 2011 09:28:37PM 11 points [-]

By presenting the antidote to Lisa in the form of an external compulsion, he allows Lisa to do what she wanted anyway and avoid feeling guilty.

Wait, what? What on Earth is the purpose of guilt if you can avoid it? Though it does disminish guilt, so it's a mechanism that removes some guilt for actions you're going to continue despite guilt... but what for? It it completely removed guilt, might as well not generate guilt for actions reinforced that strongly. (And if not, why does it exist?) And it's not like you don't continue - so why would it replace guilt as a signal of cooperation?

One of the classic stereotypes of the insane is that they hear voices telling them to kill people.

Two hypotheses: Someone with voices saying "Kill them!" is more likely than someone with voices saying "Let's go fishing!" to be institutionalized. Mental illness is influenced by culture, which propagates this cliché.

Anecdote: Once I had a voice. It told me to do minor random stuff - cross the street at an unusual point, take a parallel street, explore a part of town. I obeyed because why not. Then out of the blue it told me to kill the next person I saw. I laughed at the obvious cliché and pushed the voice away until it was gone.

Comment author: Yvain 13 July 2011 09:42:30PM *  4 points [-]

Wait, what? What on Earth is the purpose of guilt if you can avoid it?

I'm not sure what's surprising you here. You don't think John would feel more guilty if he had to beg Lisa for an antidote that she also wanted, than if Lisa said "I gave it to you this morning in your coffee, the decision was never in your hands"?

You can find more on what I think of guilt here.

As for your voice - did it sound more like an intrusive thought? Or did it sound like an external person talking, heard exactly as loudly and clearly as if it were your mother or your friend talking to you? Was it your own voice, the voice of someone you knew, or a stranger?

Comment author: Wei_Dai 13 July 2011 11:30:19PM *  7 points [-]

It sounds like you're saying that evolution built a self-punishment system (which we call "guilt"), but then built another mechanism that let's certain behaviors escape that self-punishment system (by having our minds view them as compulsions). Is that right?

Can you explain why it might be evolutionarily advantageous to visibly self-punish some socially unacceptable behaviors, but not others? And what criteria does the brain actually use to make this (subconscious) choice?

Comment author: Yvain 14 July 2011 08:01:32PM 2 points [-]

Thanks for the rephrasing. I now understand MixedNuts' question better.

I don't think the purpose of the ego syntonic/dystonic distinction is to get rid of guilt, but to create a more socially acceptable framing, which may accompany guilt.

Consider the case of a pastor with homosexual urges. If they're mild, he can hide it from himself. If they're stronger, and he engages in homosexual behavior, he can't. If he gets caught, then he'll probably phrase it as "I get these temptations, can't do anything about it" instead of as "Yeah, turns out I'm a homosexual and following the Bible isn't that important to me", go to some sort of 'therapy', and be forgiven while continuing to hold most of his previous beliefs about himself. He'll probably still feel guilty about it either way.

Comment author: Wei_Dai 14 July 2011 08:25:57PM *  5 points [-]

I don't think the purpose of the ego syntonic/dystonic distinction is to get rid of guilt, but to create a more socially acceptable framing, which may accompany guilt.

I'm confused because in the post you wrote:

Under Trivers' hypothesis, the compulsion for heroin works the same way. The heroin addict's definitely going to get that heroin, but by presenting the desire in the form of an external compulsion, the unconscious saves the heroin addict from the guilt of "choosing" heroin.

Which makes it sound like the purpose of the ego syntonic/dystonic distinction is to get rid of guilt. Are you actually saying that the purpose is really to create a more socially acceptable framing, but as a side effect it might sometimes alleviate guilt?

Comment author: Yvain 14 July 2011 09:03:25PM *  6 points [-]

I think this is a case where I knew what I meant and so I wrote something that activated the appropriate ideas in my head but was misleading and unable to communicate the appropriate ideas. I've fixed it by changing "guilt" to "social stigma".

Comment author: Wei_Dai 16 July 2011 12:23:36AM *  3 points [-]

Thanks for the clarification. I think I agree with Nesov that conscious goals are not necessarily those that are socially acceptable. It may be that the conscious/subconscious distinction originally had much to do with signalling socially acceptable values, but I think since then our actual consciously held values have been the result of a memetic evolution where fitness is determined by many factors besides just "social acceptability". Otherwise it seems hard to explain why some people endorse utilitarianism, others endorse egoism, still others endorse Christian deontology, and so on, even when they live in the same society.

ETA: One example of such a memetic fitness "factor" is how well the values prescribed by the meme fits with our existing intuitions about what an ethical system ought to look like, which might in turn come from thinking about something that's not necessarily related, such as math. See my Why Do We Engage in Moral Simplification? for a more detailed example of this.

Comment author: TheOtherDave 14 July 2011 09:04:46PM 2 points [-]

(nods) Agreed in principle.

Though it's worth noting that the threshold for self-deception isn't quite as low as you suggest. There exist pastors (and non-pastors) who engage in same-sex sex acts but maintain a heterosexual self-image, or who engage in opposite-sex sex acts but maintain an ascetic self-image. One easy way to do this, for example, is to ascribe all the agency to their sex partners ("I'm straight/celibate, but that tempter/temptress seduced me"), or the situation ("...but I'd had a few drinks too many"), or to more complicated ontological entities (e.g., Satan). That way they get to reframe themselves as helpless-and-blameless.

Comment author: MixedNuts 13 July 2011 10:00:01PM 3 points [-]

I'm not sure what's surprising you here.

I'm pointing out that guilt as a signal you won't (can't) defect is made useless by having a system to remove guilt.

That one voice sounded like an intrusive thought, yeah. I get other voices of this type (thoughts in my head, and compulsion to write down things I can't (much) predict), but they don't want to grab me and direct me to do stuff, though they may advise (the most coherent ones are usually religious figures telling me religious stuff I should do; they're accompanied with emotions, usually serenity or awe). I also get regular auditory hallucinations, but if they're voices they just tend to call my name or whatever.

Comment author: dvasya 13 July 2011 10:48:53PM *  1 point [-]

I'm pointing out that guilt as a signal you won't (can't) defect is made useless by having a system to remove guilt.

It's not like John is removing his own guilt for breaking Lisa's neck and taking the antidote by making himself believe that what really happened is that she actually gave it to him in his coffee and then died of poisoning. Here, guilt is removed sort of from the outside, by the society, which actually seems to make sense from the point of view of removing false (from the society's point of view) positives, while keeping all the social benefits of guilt. But, true, this mechanism can be exploited via making up imaginary friends.