pjeby comments on Meditation, insight, and rationality. (Part 1 of 3) - Less Wrong

35 Post author: DavidM 28 April 2011 08:26PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (120)

You are viewing a single comment's thread. Show more comments above.

Comment author: pjeby 28 April 2011 09:16:24PM 13 points [-]

I asked if that meant that if I was enlightened, I would feel the same thing regardless of whether or not an evil tyrant was torturing his people.

I don't know about the particular branch of Buddhism you've encountered, but Zen certainly detaches the concept of "right action" from emotional attachment.

In Zen, it might be considered a just and proper action to go and overthrow the tyrant, but spending a lot of time being upset about the existence of tyranny would not be.

Comment author: MinibearRex 29 April 2011 02:32:40AM 1 point [-]

I think it was a Tibetan strand...I seem to recall someone saying something about "diamond way".

I suppose I can somewhat support that idea. Obsessing about something isn't a great way to do anything. My own complaint was that basically I did think that I should be more upset, at least on some level, if I learned that crimes against humanity were being committed, than I would be if that wasn't going on, and they seemed to be telling me that I was wrong about that.

Comment author: pjeby 29 April 2011 03:31:16AM 3 points [-]

I did think that I should be more upset, at least on some level, if I learned that crimes against humanity were being committed, than I would be if that wasn't going on

Why?

Comment author: MinibearRex 29 April 2011 04:13:19AM 0 points [-]

Feelings of upsetness and contentedness arise out of my utility function. I have a negative term in my utility function for crimes against humanity. That is why I prefer outcomes where people are not being tortured by dictators. Removing that term seems to me to be the equivalent of Gandhi taking the murder pill; it's something I do not want to do. That is one of the preferences that I prefer not to get rid of.

Comment author: wedrifid 29 April 2011 05:05:28AM *  19 points [-]

Feelings of upsetness and contentedness arise out of my utility function.

They need not. And if you do, in fact, have a preference to be upset in a given situation that is independent of your preference for that situation not existing. It is martyrdom, not altruism. Of potential signalling benefit to yourself but no benefit to what you ostensibly assign value to.

Removing that term seems to me to be the equivalent of Gandhi taking the murder pill

Not remotely. It is equivalent to Gandhi not self flagellating every time someone else murders someone. In fact, it is not even equivalent to that. Gandhi did engage in hunger strikes when certain undesirable things happened but those at least had instrumental value. Because Gandhi was a brilliant politician who had learned how to harness martyrdom effectively. It would be equivalent to Gandhi secretly self flagellating and making sure nobody ever found out.

Assigning negative utility to crimes against humanity is an entirely different thing to assigning positive utility to your personal misery. The latter is primarily what we do to signal to ourselves and others that we are altruistic while excusing ourselves from actually doing something about it.

Comment author: MinibearRex 29 April 2011 08:17:13PM 2 points [-]

I did not communicate what I meant to say very well. I'll try again.

I view my utility function as a mathematical representation of all of my own preferences. My working definition of "preferences" is: conditions that, if satisfied by the universe, will cause me to feel good about the universe's state, and if unsatisfied by the universe, will cause me to feel bad about the universe's state. When I talk about "feeling good" and "feeling bad" in this context, I'm trying to refer to whatever motivation it is that causes us to try to maximize what we call "utility". I don't know a good way in english to differentiate between the emotion that is displayed, for instance when a person is self flagellating, and the emotion that causes someone to try to take down a corrupt ruler.

If I learn that some dictator ruling over some other country is torturing and killing that country's people, my internal stream of consciousness may register the statement, "That is not acceptable. What should I do to try to improve the situation of the people in that country?" That is a negative "feeling" produced by the set of preferences that I label "morality". I do not particularly want the parts of my brain that make me moral to vanish. I do not want to self modify in such a way that I will genuinely have no preference between a world where the leader of country X is committing war crimes, and a world where country X is at peace and the population is generally well off.

Should I mope around and feel terrible because the citizens of country X are being tortured? Of course not. That's unhelpful. I do not, in fact, have a positive term in my utility function for my own misery, as my earlier post, now that I've reread it, seems to imply. Rather, I have a positive term in my utility function for whatever it is that doesn't make a person a sociopath, and that was what I was trying to talk about.

Comment author: pjeby 30 April 2011 12:43:14AM 13 points [-]

My working definition of "preferences" is: conditions that, if satisfied by the universe, will cause me to feel good about the universe's state, and if unsatisfied by the universe, will cause me to feel bad about the universe's state.

That's not really a preference. A preference is, "I like strawberry ice cream better than vanilla". I experience more utility from strawberry than vanilla, but this doesn't make me feel bad if there's only vanilla.

It is a serious misunderstanding of the human cognitive architecture to assume that an unfulfilled preference should cause you to feel bad.

my internal stream of consciousness may register the statement, "That is not acceptable. What should I do to try to improve the situation of the people in that country?" That is a negative "feeling"

No, that's a statement. How you choose to feel about that statement is a separate event.

Rather, I have a positive term in my utility function for whatever it is that doesn't make a person a sociopath

Was Gandhi a sociopath? Dr. Martin Luther King Jr.? Their speeches seem to be a good example of Buddhist thought in action: motivation via compassion, rather than outrage.

That is, "people are suffering, I want to help them", not "that's unacceptable and bad."

From my observation of some philanthropists I know, they do not appear to be feeling bad about people suffering in Africa; they instead feel good about being able to do something.

People who feel bad have protests and "raise awareness"... people who feel good, OTOH, seem to actually go to Africa and do something.

So, when somebody protests that they'll become immoral if they don't feel bad about something, my general impression is that the signaling part of their brain is currently running the show -- i.e., what other people will think is currently more important to them than whatever the ostensible goal of their emoting is. Think Hansonian, "X is not about X".

Heck, let's just make it specific: "Feeling Bad About Moral Issues Is Not About Actually Doing Anything About Them".

Comment author: MinibearRex 30 April 2011 01:28:11AM 4 points [-]

That's not really a preference. A preference is, "I like strawberry ice cream better than vanilla". I experience more utility from strawberry than vanilla, but this doesn't make me feel bad if there's only vanilla.

If I am forced to eat vanilla ice cream, it will not ruin my week. It will not even make me upset; it's not like the term in my utility function for vanilla ice cream is negative. I prefer vanilla ice cream to nothing at all. I will, however, be generally happier if I eat chocolate ice cream than vanilla. I like it more. If I genuinely was as happy while/after eating vanilla ice cream as I am while/after eating chocolate, saying I had a "preference" in either direction would be meaningless.

my internal stream of consciousness may register the statement, "That is not acceptable. What should I do to try to improve the situation of the people in that country?" That is a negative "feeling"

No, that's a statement. How you choose to feel about that statement is a separate event.

That statement never would have shown up in my stream of consciousness without some emotion causing it to appear. A person who genuinely does not have positive or negative emotions about a topic is extremely unlikely to use the term "not acceptable". That statement was motivated by a feeling. In my case, if I hear about crimes against humanity, the immediate response is actually a small flash of anger towards the ruler, and sympathetic pain with regards to the population. Those feelings sparks the thought, "what can I do?", and I think that's how it should be.

That is, "people are suffering, I want to help them", not "that's unacceptable and bad."

That statement, "people are suffering, I want to help" is sparked by sympathetic pain. If they didn't feel any pain on behalf of others, that motivation to help wouldn't have ever popped into their heads.

From my observation of some philanthropists I know, they do not appear to be feeling bad about people suffering in Africa; they instead feel good about being able to do something.

I hope I never get to the point where I think the statement, "Oh boy, people are hurting! What an exciting opportunity for me to do something that I find to be pleasurable!"

I don't believe that's how philanthropists typically think. I'm involved in biological research, trying to find cures and treatments for diseases. I enjoy that. The research is interesting, the people are fun to interact with, and I'm helping to increase the lifespans, happiness, and health of a lot of people. My motivations are twofold. There is the hedonic aspect; I like my job. There is also a moral motivation. I feel sympathetic pain when I see someone with Alzheimer's, or cancer, or any other disease, and I feel sympathetic joy when those people get better. Now, if Omega were to drop down from the sky and offer me a cure for Alzheimer's for $50, if my primary motivation was that I enjoyed the work of helping people, I wouldn't pay. If I pay for it, I don't get to do the work. However, what I enjoy more is actually people getting help. I fork over the cash immediately.

So, when somebody protests that they'll become immoral if they don't feel bad about something, my general impression is that the signaling part of their brain is currently running the show

Most people that say that probably are just trying to appear moral. I don't condone moping around and enjoying the fact that you're so emotional about the plight of the poor indigenous people, etc. But that little twinge of sympathetic pain you get when you hear about some tinpot dictator torturing his people is not something I'm particularly eager to remove from human brains. You're right, feeling upset by an immoral situation isn't doing anything, but that upsetness is what motivates us to do something.

Comment author: pjeby 30 April 2011 04:03:36PM *  14 points [-]

that little twinge of sympathetic pain

Zen doesn't have any objection to momentary twinges, so long as they don't interfere with anything practical. (See, e.g., the story of the two monks whose punchline is "Are you still carrying her?")

I think that Asimov's "never let your sense of morals prevent you from doing what is right" is a very Zen saying. ;-)

I hope I never get to the point where I think the statement, "Oh boy, people are hurting! What an exciting opportunity for me to do something that I find to be pleasurable!"

Come on now. Do you want to tell me that writing that sentence didn't just give you an enjoyable feeling of righteous indignation?

See, there are many kinds of "feeling good" besides "pleasure". Love and compassion feel good... and so too, unfortunately, does righteous indignation.

However, not all kinds of feeling good motivate the same kinds of actions - each comes with its own bias as to what type of actions are selected. Indignation and love, obviously, motivate different sorts of actions, despite both feeling good!

Notice, btw, that I'm speaking here of what actions are motivated by having the feeling, which is a different thing than the motivation to obtain the feeling. The pleasure of having ice cream is not the same as having a desire to get some.

This is because humans are not utility maximizers; we're more like time-averaged satisficers. Desire arises when our time-averaged measurement of some physical or virtual property (like "blood sugar level" or "amount of interesting stuff to do") drops below some reference point, and we then take action to restore that property to a perceived-safe or optimal level.

This is why trying to discuss humans behavior in terms of "utility" is a complete waste of time if you want to understand what's actually going to happen when you self-modify.

At a fundamental level, we are not utility maximizers, even though we can certainly entertain the belief that we desire to be utility maximizers, or participate in competitive or co-operative frameworks that collectively aim towards maximizing something (e.g. corporations).

There is the hedonic aspect; I like my job. There is also a moral motivation.

Yeah... this is where we need to sort out the signaling.

See, here's what I said:

From my observation of some philanthropists I know, they do not appear to be feeling bad about people suffering in Africa; they instead feel good about being able to do something.

You then basically said this is terrible, and that you have "moral" motivation instead. But then, you go on to say:

However, what I enjoy more is actually people getting help.

Uh, so how is that not feeling good "about being able to do something"?

You're right, feeling upset by an immoral situation isn't doing anything, but that upsetness is what motivates us to do something.

Really? Let's test that, shall we.

Which of the following more closely matches your experience every day:

  • "Man, the world is full of diseased people. I feel awful. Better get to work right away..."

  • "Man, I'm glad I can make a difference. Let's get to work!"

It's really easy to test my hypothesis: different emotions bias people towards different types of action. (Actually, I'd guess that if you put it that broadly, there's probably already plenty of research to support it.)

More specifically, though, my thesis is that most emotions we describe as "negative" do not support any sort of sustained activity over time, in the absence of a visceral, immediate threat. They especially don't support creative or imaginative thinking, or indeed any sort of clear, non-rote thinking at all. (Also fairly-well documented.)

IOW, negative emotions bias towards short-term, rote and reactive behaviors, which make them far less useful for actually changing anything. They're designed for emergency responses, not ambitious campaigns of action.

Sure, negative emotions can motivate us to "do something"... the problem is, it's the sort of motivation that leads to the syllogism:

  1. We must do something!
  2. This is something.
  3. Therefore, we must do this.

In other words, a short-term emergency response.

None of the philanthropists I know seem to view their activities as an emergency, and they take thoughtful and considered long-term actions. When they speak, they don't seem to me to be experiencing any negative emotion. They say, "These people don't have water. We can help them. Let's do this!"

Now, there is one category of negative emotion that appears to produce motivation, and that'd be the category that contains moral signaling emotions, such as righteous indignation, disgust, disapproval, etc.

People under the influence of these emotions often appear to be "doing something", but that "something" is usually something like protesting, "raising awareness", or engaging in other "X is not about Y" activities.

That's because these emotions bias us towards activities of protest and punishment. And, as I mentioned in the "offense" thread recently, such protest and punishment actions usually don't accomplish anything, while making us feel like we're accomplishing something... thus leading to a perverse form of covert procrastination.

(Like spending a lot of time being mad about having to take out the trash, instead of just taking the trash out already so you don't have to think about it any more!)

For this reason, my most recent major change in mind-hacking heuristics is to look for a pattern of moral disapproval of something...

And then have the subject get rid of it.

Because when we're under the influence of those "moral" feelings, our brains seem blocked from thinking about how to solve the actual problem, vs. just protesting it in some way, and maybe trying to get other people to do something about it!

Which means that Asimov really was right after all.

Because, as it turns out, our feelings of moral disapproval -- our "sense of morals", if you will -- really does prevent us from doing what is right.

And that's why you're wrong about upset being motivating. The feeling of disapproval ("this is unacceptable") is distinct from the feeling of sympathy or compassion evoked by someone else's suffering, and each feeling will motivate you to do different things, over different time periods.

P.S. One secondary effect of moral feelings that I've noticed, is that they motivate us to speak out in favor of keeping the morals that generate them. Which makes sense if you think about tribal politics: anybody who suggests that maybe we shouldn't get so upset about people pissing in the river is probably pissing in the river him/herself, and so should be publicly disapproved of -- i.e., punish the advocate of non-punishing.

This happens with me too, with every stupid "moral" injunction I remove: my first emotional response is to protest that if I, say, stop disapproving of people who aren't sufficiently perfectionistic, then somehow society will collapse and the world will be in chaos.

While that might've been the case in our ancestral environment, the truth in today's world is that the only thing affected by me stopping my disapproval is that I'll be nicer to people who weren't going to change because of my disapproval anyway. ;-)

So... I suggest you consider whether your reaction to what the Buddhists said, and what I'm saying, is simply a protest from that part of your brain that motivates the maintenance of moral rules, whether or not there's any real consequences for changing the rules.

In the modern world, where few of us hold any real punishment powers over most of the people we encounter, moral disapproval is by and large a maladaptive response.

Comment author: MinibearRex 30 April 2011 06:22:55PM 2 points [-]

I think we're going in circles here. I'm agreeing with almost everything you're saying; I think we're just using different terms for the same thing and the same term for different things.

Trying to make my point as simple and brief as possible: if I see someone hurting, I get a small twinge of sympathetic pain. That pain sparks the conscious response, "What needs to be done in order to help this person?", and I start to think about how the problem arose, how to fix it, etc. If I see someone who was in pain and now has been helped by me, I feel a small spike in sympathetic joy.

I have no particular problems with this particular mental algorithm. But, the group of Buddhists I was talking to said that this algorithm was bad, and that I should get rid of it. My understanding from what you've said, and what other people have told me, is that this not the position of most Buddhists. Since that qualm about Buddhist meditation practices has now been satisfied, I'm looking forward to reading the rest of the posts in this sequence.

Comment author: NancyLebovitz 01 May 2011 03:40:18PM 1 point [-]

I'm replying to a small part of a post which generally seems reasonable.

"This is unacceptable!" strikes me as a useful motivator for well-defined, achievable territorial defense. If I have a splinter in my foot, seeing it as unacceptable strikes me as part of the motivation for removing the splinter. I need to have enough calm mixed in to make sure I have good lighting, an appropriate tool, and the patience to make sure I get all of the splinter out, but I'm also served by having enough impatience that I'm not willing to put up with continuing to have any fraction of the splinter still in my foot.

The emotional state when I insisted that someone get his car out of a flea market space I'd rented doesn't seem all that different. His car in that location wasn't acceptable. I wasn't planning on a crusade to get all inappropriately parked cars moved at that flea market, or at all flea markets.

Of course, it gets more complicated when there's a large social issue really involved. Afaik, abolitionism really did work in Britain because a great many people thought slavery was unacceptable. The process took about a century.

And I've spent a lot of time on unproductive outrage, so I'm not saying you're completely wrong, but either the question is more complex than you say, or there's more than one flavor of "That's unacceptable!".

Comment author: Alex_Altair 30 April 2011 12:00:12AM 1 point [-]

I think the terminology I use for what you're talking about is simply "desire". Desire is definitely separate from, but related to, the emotions that motivate. I think failure to separate these concepts is responsible for some stereotypes of rationality (see Dr. Manhattan). So, while controlling emotions is helpful, changing my desires is effectively changing my utility function. This can get a little complicated in some areas such as procrastination, but in general I want to keep them.

This is one of the things that turns me off the most from Buddhism. I'm interested in meditation and deep introspection, but the Four Nobel Truths at the heart of Buddhism start out as:

1) All life is suffering. 2) The cause of suffering is craving. 3) Therefore we should stop craving.

If "craving" means desire, then this is horrible. But if it means something else, then I'm interested.

Comment author: MinibearRex 30 April 2011 12:59:12AM 1 point [-]

I agree with what you there. The problem is, "desire" is not very much different from "preference", and I think that those thingies are inextricably bound up in emotions. If you purge emotions, I think your desires would go away too, which would probably make you indistinguishable from a computer in standby mode.

Comment author: AdeleneDawner 30 April 2011 01:09:17AM 6 points [-]

If you purge emotions, I think your desires would go away too, which would probably make you indistinguishable from a computer in standby mode.

This sounds like a theory that could use testing.

Comment author: gwern 30 April 2011 03:45:27AM 0 points [-]

I think it has, in effect, with aboulia: http://en.wikipedia.org/wiki/Aboulia

"Reason is, and ought only to be the slave of the passions, and can never pretend to any other office than to serve and obey them..."

Comment author: MinibearRex 30 April 2011 01:31:28AM 0 points [-]

Minds, as we know them, are engines of optimization. They try to twist reality into a shape that we want. Imagine trying to program a computer without having a goal for the program. I think you're going to run into some challenges.

Comment author: AdeleneDawner 29 April 2011 10:32:56PM 1 point [-]

How does your system handle jealousy, rage, and desire-for-revenge?

Comment author: AdeleneDawner 29 April 2011 04:25:11AM 2 points [-]

The first sentence of that response seems to be unrelated to the rest of it. What does the rest of it have to do with feeling upset?

Comment author: MinibearRex 29 April 2011 08:18:38PM 0 points [-]

I didn't communicate what I meant by "feeling upset" clearly. I tried to clarify that here.

Comment author: AdeleneDawner 29 April 2011 02:38:54AM 1 point [-]

What do you mean by 'should' in this context? And how did you come to that conclusion?

(I know that these questions sound rhetorical, and it may be useful in a sense to take them that way, but they're not intended to be. Rather, I'm actually curious; my mind naturally works in a rather Buddhist kind of way, and never generates that kind of conclusion except in a purely instrumental sense, and I've always wondered how normal people do it.)