steven0461 comments on Raising the Sanity Waterline - Less Wrong

112 Post author: Eliezer_Yudkowsky 12 March 2009 04:28AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (207)

You are viewing a single comment's thread. Show more comments above.

Comment author: steven0461 12 March 2009 04:48:00PM 6 points [-]

If religion making people happier is a special case of conformity to prevalent ideas making people happier, then the happiness benefit from religion is strictly vampiric in nature. God knows religious people make me unhappy.

Comment author: pjeby 12 March 2009 05:35:41PM -2 points [-]

In which case, the rational thing would be to get rid of whatever emotional belief causes them to make you unhappy. Why be unhappy about a mere fact?

Comment author: Eliezer_Yudkowsky 12 March 2009 07:02:41PM 8 points [-]

Why be unhappy about something that isn't a fact?

Comment author: pjeby 12 March 2009 07:10:03PM -1 points [-]

I don't understand your question. Are you trying to make a case for unhappiness being useful, or supporting the idea that unhappiness is not useful?

Comment author: Eliezer_Yudkowsky 12 March 2009 07:32:57PM 5 points [-]

I'm saying that if you're going to be unhappy about anything - a position I do currently lean toward, albeit with strong reservations - then you should be unhappy about facts.

Comment author: pjeby 12 March 2009 08:07:49PM 2 points [-]

In order to be unhappy "about" a fact, the fact has to have some meaning... a meaning which can exist only in your map, not the territory, since the fact or its converse have to have some utility -- and the territory doesn't come with utility labels attached.

However, there's another source of possible misunderstanding here: my mental model of the brain includes distinct systems for utility and disutility -- what I usually refer to as the pain brain and gain brain. The gain brain governs approach to things you want, while the pain brain governs avoidance of things you don't want.

In theory, you don't need anything this complex - you could just have a single utility function to squeeze your futures with. But in practice, we have these systems for historical reasons: an animal works differently depending on whether it's chasing something or being chased.

What we call "unhappiness" is not merely the absence of happiness, it's the activation of the "pain-avoidance" system -- a system that's largely superfluous (given our now-greater reasoning capacity) unless you're actually being chased by something.

So, from my perspective, it's irrational to maintain any belief that has the effect of activating the the pain brain in situations that don't require an urgent, "this is a real emergency" type of response. In all other kinds of situations, pain-brain responses are less useful because they are:

  • more emotional
  • more urgent and stressful
  • less deep thinking
  • less creativity and willingness to explore options
  • less risk-taking

And while these characteristics could potentially be life-saving in a truly urgent emergency... they are pretty much life-destroying in all other contexts.

So, while you might have a preference that people not be religious (for example), there is no need for this preference not being met, to cause you any actual unhappiness.

In other words, you can be happy about a condition X being met in reality, without also requiring that you be unhappy when condition X is not met.

Comment author: Annoyance 12 March 2009 08:13:20PM 3 points [-]

I agree with your reasoning, but I think there are plenty of reasons to be unhappy about religion that go beyond the absence of a preferred state.

In other words, I think I should be actively displeased that religion exists and is prevalent, not merely being non-happy. Neutrality is included in non-happiness, and if the word were used logically, unhappiness. But the way it's actually used, 'unhappy' means active displeasure.

Comment author: pjeby 12 March 2009 08:37:28PM 0 points [-]

How is this active displeasure useful to you? Does it cause you to do something different than if you merely prefer religion to not be present? What, specifically?

Comment author: Eliezer_Yudkowsky 12 March 2009 08:18:47PM 11 points [-]

Should I not be unhappy when people die? I know that I could, by altering my thought processes, make myself less unhappy; I know that this unhappiness is not cognitively unavoidable. I choose not to avoid it. The person I aspire to be has conditions for unhappiness and will be unhappy when those conditions are met.

Our society thinks that being unhappy is terribly, terribly sinful. I disagree morally, pragmatically, and furthermore think that this belief leads to a great deal of unhappiness.

(My detailed responses being given in Feeling Rational, Not For the Sake of Happiness Alone, and Serious Stories, and furthermore illustrated in Three Worlds Collide.)

Comment author: pjeby 12 March 2009 08:36:26PM 0 points [-]

I don't know. Is it useful for you to be unhappy when people die? For how long? How will you know when you've been sufficiently unhappy? What bad thing will happen if you're not unhappy when people die? What good thing happens if you are unhappy?

And I mean these questions specifically: not "what's good about being unhappy in general?" or "what's good about being unhappy when people die, from an evolutionary perspective?", but why do YOU, specifically, think it's a good thing for YOU to be unhappy when some one specific person dies?

My hypothesis: your examination will find that the idea of not being unhappy in this situation is itself provoking unhappiness. That is, you think you should be unhappy when someone dies, because the idea of not being unhappy will make you unhappy also.

The next question to ask will then be what, specifically, you expect to happen in response to that lack of unhappiness, that will cause you to be unhappy.

And at that point, you will discover something interesting: an assumption that you weren't aware of before.

So, if you believe that your unhappiness should match the facts, it would be a good idea to find out what facts your map is based on, because "death => unhappiness" is not labeled on the territory.

Comment author: Eliezer_Yudkowsky 12 March 2009 08:45:32PM 4 points [-]

Pjeby, I'm unhappy on certain conditions as a terminal value, not because I expect any particular future consequences from it. To say that it is encoded directly into my utility function (not just that certain things are bad, but that I should be a person who feels bad about them) might be oversimplifying in this case, since we are dealing with a structurally complicated aspect of morality. But just as I don't think music is valuable without someone to listen to it, I don't think I'm as valuable if I don't feel bad about people dying.

If I knew a few other things, I think, I could build an AI that would simply act to prevent the death of sentient beings, without feeling the tiniest bit bad about it; but that AI wouldn't be what I think a sentient citizen should be, and so I would try not to make that AI sentient.

It is not my future self who would be unhappy if all his unhappiness were eliminated; it is my current self who would be unhappy on learning that my nature and goals would thus be altered.

Did you read the Fun Theory sequence and the other posts I referred you to? I'm not sure if I'm repeating myself here.

Comment author: pjeby 12 March 2009 09:14:45PM 0 points [-]

I'm unhappy on certain conditions as a terminal value, not because I expect any particular future consequences from it.

Really? How do you know that? What evidence would convince you that your brain is expecting particular future consequences, in order to generate the unhappiness?

I ask because my experience tells me that there are only a handful of "terminal" negative values, and they are human universals; as far as I can tell, it isn't possible for a human being to create their own terminal (negative) values. Instead, they derive intermediate negative values, and then forget how they did the derivation... following which they invent rationalizations that sound a lot like the ones they use to explain why death is a good thing.

Don't you find it interesting that you should defend this "terminal" value so strongly, without actually asking yourself the question, "What really would happen if I were not unhappy in situation X?" (Where situation X is actually specified to a level allowing sensory detail -- not some generic abstraction.)

It's clear from what you've written throughout this thread that the answer to that question is something like, "I would be a bad person." And in my experience, when you then ask something like, "And how did I learn that that would make me bad?", you'll discover specific, emotional memories that provide the only real justification you had for thinking this thought in the first place... and that it has little or no connection to the rationalizations you've attached to it.

Comment author: NancyLebovitz 24 March 2010 05:50:15AM 0 points [-]

Possibly relevent: A General Theory of Love suggests that love (imprinting?) includes needing the loved one to help regulate basic body systems. It starts with the observation that humans are the only species whose babies die from isolation.


I've read a moderate number of books by Buddhists, and as far as I can tell, while a practice of meditation makes ordinary problems less distressing, it doesn't take the edge off of grief at all. It may even make grief sharper.

Comment author: pjeby 12 March 2009 08:51:56PM 0 points [-]

Argh. You keep editing your comments after I've already started my replies. I guess I'll need to wait longer before replying, in future.

Your detailed responses are off-point, though, except for "Serious Stories", in which you suggest that it would be useful to get rid of unnecessary and soul-crushing pain and/or sorrow. My position is that a considerable portion of that unnecessary and soul-crushing stuff can be done away with, merely by rational examination of the emotional source of your beliefs in the relevant context.

Specifically, how do you know what "person you aspire to be"? My guess: you aspire to be that person, not because of an actual aspiration, but rather because you are repulsed by the alternative, and that the alternative is something you're either afraid you are, or might easily become. (In other words, a 100% standard form of irrationality known as an "ideal-belief-reality conflict".)

What's more, when you examine how you came to believe that, you will find one or more specific emotional experiences... which, upon further consideration, you will find you gave too much weight to, due to their emotional content at the time.

Now, you might not be as eager to examine this set of beliefs as you were to squirt ice water in your ear, but I have a much higher confidence that the result will be more useful to you. ;-)

Comment author: Eliezer_Yudkowsky 12 March 2009 09:02:51PM 7 points [-]

By "person I aspire to be" I mean that my present self has this property and my present self wants my future self to have this property. I originally wrote "person I define as me" but that seemed like too much of a copout.

Yes, I'm repulsed by imagining the alternative Eliezer who feels no pain when his friends, family, or a stranger in another country dies. It is not clear to me why you feel this is irrational. Nor is it based on any particular emotional experience of mine of having ever been a sociopath.

It seems to me that you are verging here on the failure mode of having psychoanalysis the way that some people have bad breath. If you don't like my arguments, argue otherwise. Just casting strange hints of childhood trauma is... well, it's having psychoanalysis the way some people have bad breath.

So far as I can tell, being a person who hurts when other people hurt is part of that which appears to me from the inside as shouldness.

Comment author: pjeby 12 March 2009 09:16:32PM 0 points [-]

Okay, let me rephrase. Why is it better to be a person who hurts when other people hurt, than a person who is happier when people don't hurt?

Comment author: Vladimir_Nesov 12 March 2009 11:51:03PM 2 points [-]

Sometimes the important facts of which you worry are counterfactual. Which, after all, is what happens when you decide, determining the real decision, based on its comparison to your model of its unreal alternative.

Comment deleted 12 March 2009 07:37:22PM *  [-]
Comment author: pjeby 12 March 2009 09:40:51PM 0 points [-]

How does "religious people make me unhappy" motivate anything useful? And to whom is it sending this "honest signal"? What mode of thinking is being changed?

In other words, how is being unhappy about the mere existence of religious people actually useful to the specific person who stated that?

At the moment, what you've said could equally apply to death being a good thing, because it motivates us to not waste time, and because it kills off the less intelligent. In other words, it sounds like a way to justify continued belief in the usefulness of your own unhappiness.

Comment deleted 17 March 2009 07:38:41PM [-]
Comment author: pjeby 17 March 2009 09:23:33PM -1 points [-]

That wasn't the question I answered.

But it was the question I asked, in context. The "mere fact" referred to in my question was the existence of religious people -- it was not an abstract question to be applied to any random "mere fact".

No it doesn't, that's absurd.

Right -- because that's exactly what happens when you take a point out of context, treat it as an abstraction, and then reapply it to some other specific fact than the one it was relevant to.

If unhappiness was a strictly detrimental phenonemon then we would not have evolved to experience it in such depth.

Detrimental to whom, relative to what purpose? Evolution doesn't have our personal goals or fulfillment in mind -- just reproductive success. It's merely a happy accident that some of the characteristics useful for one, are also useful for the other.

Comment deleted 12 March 2009 07:59:19PM [-]
Comment author: pjeby 12 March 2009 08:18:01PM 1 point [-]

If you want status and connection, seek them out. What does that have to do with the fact that you don't have them elsewhere?

Do you have to be unhappy because Starbuck's doesn't sell underwear, and Victoria's Secret doesn't serve coffee? Or do you just go to someplace that has whatever you're looking for at the moment?

That's how you operate when you have a preference, rather than an emotionally-backed addiction.

In this case, the emotional rule backing the addiction is a "should" -- the idea that people "shouldn't" be religious or "should" be rational. Such rules produce only pain, when you're not in a position to enforce them.

However, if you change "they should" to "I prefer", then you don't have to be unhappy when reality doesn't match your preferences. You are still free (and still motivated) to change the situation, if and when you have the power to do so, but you are not also bound to become unhappy whenever the situation is not exactly as you prefer.

Comment author: thomblake 12 March 2009 09:51:11PM 11 points [-]

Why be unhappy about a mere fact?

It's worth noting that 'mere' is a weasel word of the highest order. If you change that to 'Why be unhappy about a fact' then it loses its emotive force while having effectively the same content, unless you meant 'Why be unhappy about a fact that's not worth being unhappy about' in which case you're just baiting.

Comment author: pjeby 12 March 2009 09:55:22PM 0 points [-]

Actually, I had a specific meaning in mind for "mere" in that context: a fact, devoid of the meaning that you yourself assigned to it. The "mere fact" that Starbucks doesn't sell naughty underwear doesn't make it something to be unhappy about... it's only a problem if you insist on reality doing things the way you want them. Same thing for the existence (or lack thereof) of religious people.

Comment author: Nick_Tarleton 12 March 2009 10:06:02PM *  1 point [-]

it's only a problem if you insist on reality doing things the way you want them.

I agree that this is common and pathological, but why do you think ALL unhappiness proceeds from it? There is a middle ground between dispassionate judgment and desperate craving.

Comment author: pjeby 12 March 2009 10:20:34PM 1 point [-]

Not really: there are two utility systems, not one. The absence of pleasure does NOT equal pain, nor vice versa. They are only weakly correlated, and functionally independent: they have different effects on the brain and body. And we can have mixed feelings, because both systems can activate at the same time.

But there's no inherent reason why activating the pain system is required in the absence of any given form of pleasure, or else we'd be mind-bendingly unhappy most of the time. MOST pleasant things, in fact, we are happy about the presence of, but not necessarily unhappy at the absence of.

As for the question about "all", please give me an example of a form of unhappiness that does NOT derive from a conflict between your desires, and the current state of reality. ;-)

Comment author: Vladimir_Nesov 13 March 2009 01:23:40AM 0 points [-]

pjeby:

Not really: there are two utility systems, not one. [...]

You are professing these unorthodox claims instead of communicating them. Why should I listen to anything you say on this issue?

Comment author: Nick_Tarleton 13 March 2009 01:35:34AM 2 points [-]

Now that the idea has been singled out in hypothesis space, you can evaluate its plausibility on your own, even without supporting argument.

I didn't realize there was an orthodoxy saying that humans have one utility system.

Comment author: Vladimir_Nesov 13 March 2009 01:50:53AM 0 points [-]

Given how little we are given to go on, evaluating the plausibility of a vaguely suggested hypothesis is hard work. One should only do it if one sufficiently expects it to lead to fruition, otherwise you can solve the riddles posed by the Oracle of White Noise till the end of time. Maybe a proper writeup in a separate post will do the trick.

Comment author: pjeby 13 March 2009 03:24:37AM 2 points [-]

I don't see how they're even remotely unorthodox. Most of what I said is verifiable from your own personal experience.... unless you're claiming that if having sex gives you pleasure, then you're in constant pain when you're not having sex!

However, if you must have the blessings of an authority (which I believe is what "orthodox" means), perhaps you'll find these excerpts of interest:

In addition to behavioral data, evidence from the neurosciences is increasingly in accord with the partial independence of positive and negative evaluative mechanisms or systems (Berntson, Boysen & Cacioppo, in press; Gray, 1987, 1991). The notion dates back at least to the experimental studies of Olds (1958: Olds & Milner, 1954), who spearheaded a literature identifying separate neural mechanisms to be related to the subjective states of pleasure and pain.

...

In an intriguing study that bears on functional rather than stochastic independence, Goldstein and Strube (in press) demonstrated the separability of positive and negative affect within a specific situation and time and the uncoupled activation of positive and negative processes after success and failure feedback, respectively.

The paper containing these two excerpts (from the 1994 APA Bulletin), is probably worth reading in more detail; you can find a copy here.

So, at least in what might be loosely considered "my" field, nothing I said in the post you're referencing is exactly what I'd call "unorthodox".

Comment author: Nick_Tarleton 13 March 2009 04:30:08AM 1 point [-]

I agree with your first two paragraphs, but fail to see the relevance.

I must be matching cliches myself. I interpreted "you insist on reality doing things the way you want them" as referring to, as I said, pathological craving - a subset of "a conflict between your desires, and the current state of reality". I can't think of any unhappiness that has a reason other than that (although sometimes it has no apparent reason), but what of it? Having desires means having such a conflict (barring omnipotence or impossible luck).

Comment author: pjeby 13 March 2009 05:22:23AM 1 point [-]

My error, actually. I should have explained more clearly what I mean by "conflict"... I lapsed into a bit of a cliche there, undermining the point I was building up to from the first two paragraphs.

The key is conflict with the current state of reality, distinguished from future state. If you're busy being mad at the current state, you're probably not working as effectively on improving the future state. Negative motivation is primarily reactive, and past/present focused rather than active and present/future focused, the way positive motivation is.

A positively-motivated person is not in conflict with the current state of reality, just because he or she desires a different state. Whereas, someone with an emotion-backed "should", is in conflict.

So my question is/was, can you give an example of active unhappiness that derives from anything other than an objection to the current state of reality?

You implied that there's a "middle ground" between dispassionate judgment and desperate craving, but my entire point is that positives and negatives are NOT a continuum -- they're semi-independent axes.

Some researchers, btw, note that "affective synchrony" -- i.e., the correlation or lack thereof between the two -- is different under conditions of stress and non-stress, and conditions of high pain or pleasure. High pain is much more likely to be associated with low pleasure, and vice versa for high pleasure. But the rest of the time, for most people, they show near-perfect asynchrony; i.e., they're unrelated to each other.

Which means the "middle ground" you posit is actually an illusion. What happens is that your negative and positive evaluations mostly run in parallel, until and unless one system kicks into high gear.

You could compare it to a chess program's tree-trimming: you're cutting off subtrees based on negative evaluation, and more deeply investigating some, based on positive evaluations.

In the ancestral environment -- especially our prehuman ancestry -- this is effective, because negative branches equal death, and you don't have a lot of time to make a choice.

But in humans, most of our negative branch trimming isn't based on actual physical danger or negative consequences: it's based on socially-learned, status-based, self-judgment. We trim the action trees, not because we'll fall off a cliff, but because we'll seem like a "bad" person in some way. And our reasoning is then motivated to cover up the trimmed branches, so nobody else will spot our concerns about them.

So the trimmed branches don't show up in consciousness for long, if at all.

But, since the evaluation modes are semi-independent, we can also have a positive evaluation for the same (socially unacceptable) thought or action that we (for the moment) don't act on.

So we then experience temptation and mixed feelings... and occasionally find ourselves "giving in". (Especially if nobody's around to "catch" us!)

So this dual-axis model is phenomenally better at explaining and predicting what people actually do, than the naive linear model is. (People who approach the linear model in reality, are about as rare as people who have strongly mixed feelings all the time, at least according to one study.)

The linear model, however, seems to be what evolution wants us to believe, because it suits our need for social and personal deception much better. Among other things, it lets us pretend that our lack of action means a virtuous lack of temptation, when in fact it may simply mean we're really afraid of being discovered!

(whew, more fodder for my eventual post or series thereof!)

Comment author: thomblake 12 March 2009 10:06:38PM 2 points [-]

a fact, devoid of the meaning that you yourself assigned to it

So are you then denying meanings that come from other sources? Culturally constructed meaning? Meaning that comes from the relations between concepts?

it's only a problem if you insist on reality doing things the way you want them.

One of the best things about being human is that I insist everything happen the way that I want it to. If it doesn't, then I overcome it by replacing it, fixing it, or destroying it.

Comment author: pjeby 12 March 2009 10:12:35PM -1 points [-]

So are you then denying meanings that come from other sources?

Nope... but they're stored in you, and represented in terms of common reinforcers (to use EY's term).

One of the best things about being human is that I insist everything happen the way that I want it to. If it doesn't, then I overcome it by replacing it, fixing it, or destroying it.

You can only do that in the future, not the past. Religious people already exist, so anything bad you might feel about that fact is already pointless.

Comment author: thomblake 12 March 2009 10:16:33PM 4 points [-]

You can only do that in the future, not the past. Religious people already exist, so anything bad you might feel about that fact is already pointless.

Only if you think emotion can't influence behavior. Feeling bad about religious people existing leads Dawkins to campaign against them, which is intended to stop people from being religious. It's sortof a virtuous circle. Do you think our feelings and actions only matter if they can change the past?

Comment author: pjeby 12 March 2009 10:32:44PM -1 points [-]

And if he didn't feel so badly about them, he might campaign in ways that were more likely to win them over. ;-) He seems far more effective at rallying his base than winning over the undecided.

In fact, it might be interesting to objectively compare the results of sending negatively- and positively- motivated atheists to speak to religious groups or individuals, and measure the religious persons' attitudes towards atheism and religion afterwards, as well as the long-term impact on (de)conversions.

I would predict better success for the positively-motivated persons... if only because positive motivation is a stronger predictor for success at virtually everything than negative motivation is!