Are wireheads happy?

68Yvain01 January 2010 04:41PM

Related to: Utilons vs. Hedons, Would Your Real Preferences Please Stand Up

And I don't mean that question in the semantic "but what is happiness?" sense, or in the deep philosophical "but can anyone not facing struggle and adversity truly be happy?" sense. I mean it in the totally literal sense. Are wireheads having fun?

They look like they are. People and animals connected to wireheading devices get upset when the wireheading is taken away and will do anything to get it back. And it's electricity shot directly into the reward center of the brain. What's not to like?

Only now neuroscientists are starting to recognize a difference between "reward" and "pleasure", or call it "wanting" and "liking". The two are usually closely correlated. You want something, you get it, then you feel happy. The simple principle behind our entire consumer culture. But do neuroscience and our own experience really support that?

It would be too easy to point out times when people want things, get them, and then later realize they weren't so great. That could be a simple case of misunderstanding the object's true utility. What about wanting something, getting it, realizing it's not so great, and then wanting it just as much the next day? Or what about not wanting something, getting it, realizing it makes you very happy, and then continuing not to want it?

The first category, "things you do even though you don't like them very much" sounds like many drug addictions. Smokers may enjoy smoking, and they may want to avoid the physiological signs of withdrawl, but neither of those is enough to explain their reluctance to quit smoking. I don't smoke, but I made the mistake of starting a can of Pringles yesterday. If you asked me my favorite food, there are dozens of things I would say before "Pringles". Right now, and for the vast majority of my life, I feel no desire to go and get Pringles. But once I've had that first chip, my motivation for a second chip goes through the roof, without my subjective assessment of how tasty Pringles are changing one bit.

Think of the second category as "things you procrastinate even though you like them." I used to think procrastination applied only to things you disliked but did anyway. Then I tried to write a novel. I loved writing. Every second I was writing, I was thinking "This is so much fun". And I never got past the second chapter, because I just couldn't motivate myself to sit down and start writing. Other things in this category for me: going on long walks, doing yoga, reading fiction. I can know with near certainty that I will be happier doing X than Y, and still go and do Y.

Neuroscience provides some basis for this. A University of Michigan study analyzed the brains of rats eating a favorite food. They found separate circuits for "wanting" and "liking", and were able to knock out either circuit without affecting the other (it was actually kind of cute - they measured the number of times the rats licked their lips as a proxy for "liking", though of course they had a highly technical rationale behind it). When they knocked out the "liking" system, the rats would eat exactly as much of the food without making any of the satisifed lip-licking expression, and areas of the brain thought to be correlated with pleasure wouldn't show up in the MRI. Knock out "wanting", and the rats seem to enjoy the food as much when they get it but not be especially motivated to seek it out. To quote the science1:

Pleasure and desire circuitry have intimately connected but distinguishable neural substrates. Some investigators believe that the role of the mesolimbic dopamine system is not primarily to encode pleasure, but "wanting" i.e. incentive-motivation. On this analysis, endomorphins and enkephalins - which activate mu and delta opioid receptors most especially in the ventral pallidum - are most directly implicated in pleasure itself. Mesolimbic dopamine, signalling to the ventral pallidum, mediates desire. Thus "dopamine overdrive", whether natural or drug-induced, promotes a sense of urgency and a motivation to engage with the world, whereas direct activation of mu opioid receptors in the ventral pallidum induces emotionally self-sufficient bliss.

The wanting system is activated by dopamine, and the liking system is activated by opioids. There are enough connections between them that there's a big correlation in their activity, but the correlation isn't one and in fact activation of the opioids is less common than the dopamine. Another quote:

It's relatively hard for a brain to generate pleasure, because it needs to activate different opioid sites together to make you like something more. It's easier to activate desire, because a brain has several 'wanting' pathways available for the task. Sometimes a brain will like the rewards it wants. But other times it just wants them.

So you could go through all that trouble to find a black market brain surgeon who'll wirehead you, and you'll end up not even being happy. You'll just really really want to keep the wirehead circuit running.

Problem: large chunks of philosophy and economics are based upon wanting and liking being the same thing.

By definition, if you choose X over Y, then X is a higher utility option than Y. That means utility represents wanting and not liking. But good utilitarians (and, presumably, artificial intelligences) try to maximize utility (or do they?). This correlates contingently with maximizing happiness, but not necessarily. In a worst-case scenario, it might not correlate at all - two possible such scenarios being wireheading and an AI without the appropriate common sense.

Thus the deep and heavy ramifications. A more down-to-earth example came to mind when I was reading something by Steven Landsburg recently (not recommended). I don't have the exact quote, but it was something along the lines of:

According to a recent poll, two out of three New Yorkers say that, given the choice, they would rather live somewhere else. But all of them have the choice, and none of them live anywhere else. A proper summary of the results of this poll would be: two out of three New Yorkers lie on polls.

This summarizes a common strain of thought in economics, the idea of "revealed preferences". People tend to say they like a lot of things, like family or the environment or a friendly workplace. Many of the same people who say these things then go and ignore their families, pollute, and take high-paying but stressful jobs. The traditional economic explanation is that the people's actions reveal their true preferences, and that all the talk about caring about family and the environment is just stuff people say to look good and gain status. If a person works hard to get lots of money, spends it on an iPhone, and doesn't have time for their family, the economist will say that this proves that they value iPhones more than their family, no matter what they may say to the contrary.

The difference between enjoyment and motivation provides an argument that could rescue these people. It may be that a person really does enjoy spending time with their family more than they enjoy their iPhone, but they're more motivated to work and buy iPhones than they are to spend time with their family. If this were true, people's introspective beliefs and public statements about their values would be true as far as it goes, and their tendency to work overtime for an iPhone would be as much a "hijacking" of their "true preferences" as a revelation of them. This accords better with my introspective experience, with happiness research, and with common sense than the alternative.

Not that the two explanations are necessarily entirely contradictory. One could come up with a story about how people are motivated to act selfishly but enjoy acting morally, which allows them to tell others a story about how virtuous they are while still pursuing their own selfish gain.

Go too far toward the liking direction, and you risk something different from wireheading only in that the probe is stuck in a different part of the brain. Go too far in the wanting direction, and you risk people getting lots of shiny stuff they thought they wanted but don't actually enjoy. So which form of good should altruists, governments, FAIs, and other agencies in the helping people business respect?

Sources/Further Reading:

1. Wireheading.com, especially on a particular University of Michigan study

2. New York Times: A Molecule of Motivation, Dopamine Excels at its Task

3. Slate: The Powerful and Mysterious Brain Circuitry...

4. Related journal articles (1, 2, 3)

Comments (59)

AndrewH25 January 2010 08:05:37PM1 point [-]

I don't smoke, but I made the mistake of starting a can of Pringles yesterday. If you >asked me my favorite food, there are dozens of things I would say before "Pringles". >Right now, and for the vast majority of my life, I feel no desire to go and get Pringles. >But once I've had that first chip, my motivation for a second chip goes through the >roof, without my subjective assessment of how tasty Pringles are changing one bit.

What is missing from this is the effort (which eats up the limited willpower budget) required to get the second Pringle chip. Your motivation for a second Pringle chip would be much lower if you only brought one bag of Pringle chips, and all bags contained one chip. However, your motivation to have another classof(Pringle) = potato chip no doubt rises -- due to the fact that chips are on your thoughts rather than iPhones.

Talking about effort allows us to bring in habits into the discussion, which you might define as sets of actions that, due to their frequent use, are much less effort to perform.

The difference between enjoyment and motivation provides an argument that could >rescue these people. It may be that a person really does enjoy spending time with >their family more than they enjoy their iPhone, but they're more motivated to work >and buy iPhones than they are to spend time with their family.

Alternatively, for potentially good reasons before (working hard to buy a house for said family), work has become habitual while spending time with the family has not. Hence, work is the default set of actions, the default no-effort state, and anything that takes time off work requires effort. Spending time with the family could do this, yet buying an iPhone with the tons of money this person has would not.

A way of summarizing the effect of effort is that it is a function of a particular persons set of no-effort (no willpower) actions. This function defines how much 'wanting' is required to do that action -- less effort actions of the same amount of 'wanting' are more 'desirable' to be done.

Willpower plays a big role in this in that you can spend willpower to pull yourself out of the default state (a default state such as being in New York), but it only last so long.

clockbackward10 January 2010 05:45:29PM2 points [-]

Perhaps it is true that our modest technology for altering brain states (simple wireheading, recreational drugs, magnetic stimulation, etc.) leads only to stimulation of the "wanting" centers of the brain and to simple (though at times intense) pleasurable sensations. On the other hand though, it seems almost inevitable that as the secrets of the brain are progressively unlocked, and as our ability to manipulate the brain grows, it will be possible to generate all sorts of brain states, including those "higher" ones associated with love, accomplishment, fulfillment, joy, religious experiences, insight, bliss, tranquility and so on. Hence, while your analysis appears to be quite relevant with regard to wireheading today, I am skeptical that it is likely to apply much to the brain technology that could exist 50 years from now.

Sebastian_Hagen04 January 2010 03:18:14PM* 5 points [-]

The first category, "things you do even though you don't like them very much" sounds like many drug addictions.

It's not limited to drugs or even similar physical stimuli like tasty food; according to my personal experience you can get the same effect with computer games. There's games that can be plenty of fun in the beginning (while you're learning what works), but stop being so once you abstract from that to a simple set of rules by which you can (usually) win, but nevertheless stay quite addictive in the latter phase. Whenever I play Dungeon Crawl Stone Soup for more than a few hours, I inevitably end up at a point where I don't even need to verbally think about what I'm doing for 95%+ of the wall-clock time spent playing, but that doesn't make it much easier to quit.

Popular vocabulary suggests that this is a fairly common effect.

k3nt05 January 2010 05:21:48AM1 point [-]

Agree 100%. I just played a flash game last night and then again this morning, because I "just wanted to finish it." The challenge was gone, I had it all figured out, and there was nothing left but the mopping up ... which took three hours of my life. At the end of it, I told myself, "Well, that was a waste of time." But I was also glad to have completed the task.

It's probably a very good thing that I've never tried any drug stronger than alcohol.

Utilitarian04 January 2010 12:01:31AM* 2 points [-]

Great post! I completely agree with the criticism of revealed preferences in economics.

As a hedonistic utilitarian, I can't quite understand why we would favor anything other than the "liking" response. Converting the universe to utilitronium producing real pleasure is my preferred outcome. (And fortunately, there's enough of a connection between my "wanting" and "liking" systems that I want this to happen!)

benthamite04 January 2010 12:39:52AM1 point [-]

I agree that this is a great post. (I'm sorry I didn't make that clear in my previous comment.)

I can't quite understand your parenthetical remark. I though your position was that you wanted, rather than liked, experiences of liking to be maximized. Since you can want this regardless of whether you like it, I don't see why the connection you note between your 'wanting' and 'liking' systems is actually relevant.

Utilitarian04 January 2010 01:02:30AM* 1 point [-]

Actually, you're right -- thanks for the correction! Indeed, in general, I want altruistic equal consideration of the pleasure and pain of all sentient organisms, but this need have little connection with what I like.

As it so happens, I do often feel pleasure in taking utilitarian actions, but from a utilitarian perspective, whether that's the case is basically trivial. A miserable hard-core utilitarian would be much better for the suffering masses than a more happy only-sometimes-utilitarian (like myself).

benthamite04 January 2010 01:17:20AM0 points [-]

Thanks for the clarification. :-)

EvelynM03 January 2010 11:29:15PM2 points [-]

I noticed the distinction between wanting and liking as a result of my meditation practice. I began to derive great pleasure from very simple things, like the quality of an intake of breath, or the color combination of trees and sky.

And, I began to notice a significant decrease in compulsive wanting, such as for excess food, and for any amount of alcohol.

I also noticed a significant decrease in my startle reflex.

Similar results have been reported from Davidson's lab at the University of Wisconsin. http://psyphz.psych.wisc.edu/

k3nt05 January 2010 05:23:39AM* 0 points [-]

Thanks for the link. I live in Madison and had no idea that this interesting stuff was being done here.

EvelynM07 January 2010 12:01:17AM0 points [-]

You're welcome!

CronoDAS02 January 2010 11:59:11PM3 points [-]

It's hard to track down specific things from that wireheading.com site, but this seems to be a good overview. Of particular note are a couple of excerpts:

The results of these experiments indicate that reinforcing brain stimulation may have two distinct effects: (a) it activates pathways related to natural drives, and (b) it stimulates reinforcement pathways normally activated by natural rewards. The empirical observations seem to contradict classic "drive-reduction" theories of reinforcement (reinforcement appears to be associated with increased drive in the EBS paradigm). However, it is not difficult to construct a plausible alternate hypothesis: Animals may self-stimulate because the stimulation provides the experience of an intense drive that is instantly reduced due to the concurrent activation of related reward neurons. This interpretation accounts neatly for many of the apparent paradoxes we have already encountered. Priming is necessary, according to this interpretation, because EBS reinforcement not only activates reward pathways but also provides the reason why that should be pleasurable (Deutsch, 1976). (This also accounts for rapid extinction, as well as the decreased efficacy of intermittent reinforcement.) The hypothesis assumes that the reinforcing properties of EBS are determined by the degree of activation of related motivational systems. It therefore accounts readily for the observed interactions between the reinforcing properties of a stimulus and various experimental conditions that affect related primary drives such as hunger. When there is little endogenous activity, for instance immediately after a meal, the stimulation elicits only a small amount of drive-related activity. Concurrent activation of related reward circuits therefore can produce only a small reinforcement effect. When hunger-related neural pathways are already active because of deprivation, the same stimulation elicits more drive and hence more reinforcement. Indeed, it may arouse the drive system sufficiently to elicit consumatory behavior that further potentiates the reinforcing effects of the electrical stimulation.

...

It is interesting to note that while the animal literature suggests that brain stimulation has positive, reinforcing effects, the human literature indicates that relief of anxiety, depression and other unpleasant affective conditions may be the most common "reward" of electrical brain stimulation in humans. Patients with electrodes in the septum, thalamus, and periventricular gray of the midbrain often express euphoria because the stimulation seems to reduce existing negative affective reactions (even intractable pain appears to loose its affective impact). However, many psychiatrists caution that this may not reflect an activation of a basic reward mechanism (Delgado, 1976; Heath et al., 1968). Relief from chronic anxiety has been reported during and even long after stimulation of frontal cortex. Again, the experiential response appears to be relief rather than reward per se (Crow&Cooper, 1972).

In general, it seems as though electrical brain stimulation isn't quite as effective at producing bliss as one might wish (or fear).

MatthewB02 January 2010 03:12:56PM5 points [-]

I will need to go back through this again, but as a DD person, I know that my ability to motivate myself to learn new things was astronomical compared to after I destroyed most of the dopaminergic systems in my head with Drug Abuse.

The largest area I have noticed is in painting and sculpting. Two areas where I used to spend inordinate amounts of time practicing/doing. I used to have the vast majority of my work-spaces covered with miniatures and sculptures that I was working on. Now... I have a hard time getting motivated to just get them out (which is I think most of the problem).

I do know that it is possible for me to mechanically activate the motivation to perform these tasks (and I am on medication that is supposed to help, but I get the feeling it isn't), just like the rats were lacking motivation to eat when their "wanting" circuits were knocked out.

Thanks for the article. I will need to dig through some posts on another forum where I recently posted a link to a paper about modifying the brains of people with obsessive-compulsions (Drug Addicts mostly) who were able to knock out the wanting to do drugs part of their brain... I'll post the title and a link as soon as I can find the name of it. It talks about some of the same things (I think it is a U of Mich. study as well)

spamham02 January 2010 09:11:27PM1 point [-]

Sorry to hear about the drug problems, but how can you be sure they "destroyed" your dopamine neurons? Not all drugs that increase these neurons' activity kill them. Psychological changes might be a simpler explanation IMHO (but I don't know you, so that might be far off the mark).

[...] knock out the wanting to do drugs part of their brain...

Sounds draconian. That part isn't just there for drugs...

MatthewB02 January 2010 09:36:46PM* 2 points [-]

I don't think that they destroyed the Dopamine neurons, just destroyed their ability to function properly. From the various scans that have been done of my brain; not only do I have a decreased production of Dopamine, but I have an increase in the number of receptor sites (I cannot recall from which area they sampled ). Thus, I have a major portion of dopamine sites that are demanding dopamine, and a shortage of dopamine to go around to satisfy the demand. I've been in so many MRI and NMR machines that I no longer even get claustrophobic.

As for the studies about creating lesions on the brain (knocking out the part of their brain that demands to do drugs)... Obviously it isn't there to want to do drugs.

It is there because it controls various aspects of our survival drives, yet they have been hijacked and malfunction due to the use/abuse (differentiation between the two) of various chemicals. The study is about the human trials of a procedure that was first done on rats and monkeys (Macaques I think) where they ablated a portion of the Amygdala and Thalamus (I cannot recall how they located it, as it was in the days before high resolution ƒMRI or NMRi), and the Rats and Monkeys went from being junkies (with either single or poly-substance dependence) to being relatively normal rats and monkeys. In the human trials, they found the same things as in the rat/monkey study, but with changes in some other behaviors in some of the participants (altered motivational drives, for instance). I know that one of the doctors is hoping to begin using this method on Sexual Predators, and also hopes to create a chemical method for altering the location of the brain that is ablated or abraided.

Anyway, I have made it through about six months of posts, and I am pretty sure that it was this year that I posted the link (in another forum... I could have sworn that I bookmarked it as well, but that might have been on my old laptop - I have a new laptop that was for "Christmas" even though I got it in November)

edit: found it:

The Neurosurgical Treatment of Addiction

loqi02 January 2010 11:55:32PM1 point [-]

From the various scans that have been done of my brain; not only do I have a decreased production of Dopamine, but I have an increase in the number of receptor sites (I cannot recall from which area they sampled ). Thus, I have a major portion of dopamine sites that are demanding dopamine, and a shortage of dopamine to go around to satisfy the demand.

If you're comfortable sharing, what drugs led to this? Cocaine? Amphetamine? Did alcohol tend to be involved?

MatthewB03 January 2010 07:01:22AM8 points [-]

Mostly it was Heroin, but there was a modest amount of Amphetamine usage involved as well (for completely patriotic reasons as well - /rolls eyes), and Cocaine became a problem for a few years, but strangely, I just stopped doing it one day like I would decide to throw out an old pair of underwear.

No alcohol was involved, which was mostly how I managed to get my brain into so many ƒMRI tunnels. I have never had any impairment from alcohol use, nor any dysfunction usage or abuse of alcohol either. Then, when several doctors found out about my anomalous cessation of cocaine, I got even more attention. That attention helped to free me from Heroin without the usual entanglement with a 12-step group or AA/NA (which at this point in time I have rather low opinions of).

I often wonder if I would still be alive if I hadn't started using these drugs though (which is contrary to what most people expect to hear). They do give a person a certain cognitive augmentation for each different drug, each of which can be highly useful depending upon the situation. I happened to be in a situation, during the 80s where amphetamines were indicated. I began to use the heroin because the amphetamines made me a little too shaky, and I liked the calm that the two drugs together gave me when having to do things... eventually though, all hell broke loose when I was no longer in that environment and still had the drug use (which rapidly turned into abuse). Fortunately, I am still alive and past that (well, the drug part of it. My brain still has some getting adjusted to life to do).

Kevin03 January 2010 11:01:17AM0 points [-]

Is the current medication you refer to an anti-depressant? Does it do anything for you at all?

MatthewB03 January 2010 12:20:10PM1 point [-]

Ugh.. I just made a huge post addressing an issue that I realized was not the one to which you are probably referring.

I don't think I referred to any current medications in the prior post. I made a reference to the use of the drugs I began to abuse, and how these allowed me to live through situations which would probably have resulted in a poor outcome otherwise (not that I could qualify the outcome as good either, save for the fact that I am alive instead of dead)...

Are you referring to the beginning of the third paragraph???

I often wonder if I would still be alive...

spamham03 January 2010 01:52:53PM1 point [-]

Kevin means this I suppose?

I do know that it is possible for me to mechanically activate the motivation to perform these tasks (and I am on medication that is supposed to help, but I get the feeling it isn't)

Kevin04 January 2010 06:01:17AM1 point [-]

Yes, thank you.

MatthewB03 January 2010 03:06:22PM1 point [-]

Ah... That... Yes... from the previous post...

I am referring mostly to anti-depressants and Drugs to control ADD, which ironically, are very much like Amphetamines (Provigil, Adderall or Ritalin, probably Provigil or Ritalin). I did a two weeks on Provigil, and I will be doing 2 weeks on Ritalin to compare the two. It is unlikely that my Dr would prescribe Adderall, but she said it isn't totally out of the question depending upon how I respond to the others (and the fact that I haven't shown any signs that I would be likely to abuse it at this point).

The current medications I am on work to a degree. I can tell when I am off my anti-depressants, for instance, yet my anti-anxiety drugs do absolutely nothing.

The drugs to control ADD are kinda a fudge by the Dr. as I have not been diagnosed explicitly as having ADD (it is something that she suspects, yet for which I haven't displayed many of the more common symptoms. If my mother had not been a Christian Scientist when I was a kid, we might have clinical records that could help out in this case a bit more), yet she feels that they will help out with some of the motivational and concentration problems I have been having with school (and life).

wedrifid02 January 2010 04:26:10AM* 10 points [-]

A University of Michigan study analyzed the brains of rats eating a favorite food. They found separate circuits for "wanting" and "liking", and were able to knock out either circuit without affecting the other (it was actually kind of cute - they measured the number of times the rats licked their lips as a proxy for "liking", though of course they had a highly technical rationale behind it).

One could come up with a story about how people are motivated to act selfishly but enjoy acting morally, which allows them to tell others a story about how virtuous they are while still pursuing their own selfish gain.

Rats! The neuroscientists were studying rats. It is troubling how easy it is to come up with these signalling stories to explain whatever observations we encounter.

What explanation can be suggested for a different mechanism for enjoying a food than the one for motivation to get food that doesn't rely on impressing our little rat friends with our culinary sophistication?

Blueberry03 January 2010 08:14:40AM* 0 points [-]

I'm not sure why this comment got upvoted so much. If I understand what you're saying correctly, you have it exactly backwards. The signaling story wasn't intended to explain the two different mechanisms, which evolved long before humans. The signaling story is just one way that the two different mechanisms affect our lives today.

SilasBarta01 January 2010 09:07:49PM* 17 points [-]

Interesting article, but these really bugged me:

1) Using the environment as an example of false revealed preference. One person's pollution never ruins "the environment", at least not "their environment". The environment is only ruined by the aggregate effects of many people's pollution; or, the person is massively polluting a different environment.

Environmental solutions require collective agreement and enforcement, not unilateral disarmament. So polluting while claiming to value the environment is not hypocrisy even in the conventional sense of the term (that you criticize here).

And this is at least the second time I've explained this to you. Please stop using it as an example.

2) This phrasing:

There are enough connections between them that there's a big correlation in their activity, but the correlation isn't one ...

That initially reads like you're saying "the correlation isn't a correlation" so I had to re-read it. I recommend using any of the following terms as a replacement for the bolded word: perfect, unity, 1.0, 1, or "equal to one", any of which would have been clearer.

(Btw, I agree with your disrecommendation of Landsburg!)

cousin_it01 January 2010 06:07:39PM12 points [-]

Great post. It raised a question for me: why did evolution give us the pleasure mechanism at all, if the urge mechanism is sufficient to make us do stuff?

timtyler01 January 2010 06:34:40PM11 points [-]

The "urge" mechanism does not help us learn to do rewarding things.

Furcas01 January 2010 09:10:14PM* 7 points [-]

I agree that pleasure has something to do with learning, but I don't see why the "urge" or "desire" mechanism couldn't help us learn to do rewarding things without the existence of pleasure.

Without pleasure, things could work like this: If X is good for the animal, make the animal do X more often.

With pleasure, like this: If X is good for the animal, make the animal feel pleasure. Make the animal seek pleasure. (Therefore the animal will do X more often.)

So pleasure would seem to be a kind of buffer. My guess is that its purpose is to reduce the number of modifications to the animal's desires, thereby reducing the likelihood of mistaken modifications, which would be impossible to override.

cousin_it01 January 2010 06:40:23PM* 1 point [-]

Awesome answer, thanks! So the "urge" mechanism is for things we know how to do, and the "pleasure" mechanism is for things we don't? Now I wonder how to test this idea.

whpearson01 January 2010 07:11:15PM5 points [-]

If dopamine = urge you can make dopamine deficient mice. They don't learn so well...

timtyler01 January 2010 08:22:01PM2 points [-]

I would say the study supports the thesis that they learn, but then aren't motivated to act:

"A retest after 24 h showed that DD mice can learn and remember in the absence of dopamine, leading to the inference that the lack of dopamine results in a performance/motivational decrement that masks their learning competence for this relatively simple task."

whpearson01 January 2010 09:01:48PM0 points [-]

I really wish I could get into that paper. I'd like to know whether was dopamine precursor given to the rats before the retest to enable eating? If so the learning may have been buffered and acquired through sleep or there is a different method for learning in sleep. I'll see if I can get to it in the next few days.

I'd agree that some learning did occur without dopamine, the knowledge of where to go was learnt. The brain is to complex to mediate all learning with direct feedback. What we are interested in is learning what should be done. That is the behaviour was learnt but that the behaviour should be performed wasn't immediately learnt. Or in other words it didn't know it should be motivated.

There is lots of work on dopamine and learning. I'm currently watching another interesting video on the subject.

Do you know of any related to opioids? All I can find some stuff on fear response learning.

Alicorn01 January 2010 10:21:54PM5 points [-]

My school let me at the full text of the paper; here 'tis.

whpearson02 January 2010 01:18:11AM0 points [-]

Thanks. I'll read it later.

Vladimir_Nesov01 January 2010 07:42:14PM* 1 point [-]

A bad experiment specification: it only tests that brains don't work so well after you damage them. (That is, more detail is absolutely necessary in this case.)

whpearson01 January 2010 07:58:01PM* 2 points [-]

From the link (pretty much the whole content unless you have access)

Dopamine-deficient (DD) mice have selective inactivation of the tyrosine hydroxylase gene in dopaminergic neurons, and they die of starvation and dehydration at 3-4 weeks of age. Daily injections of L-DOPA (50 mg/kg, i.p.) starting approximately 2 weeks after birth allow these animals to eat and drink enough for survival and growth. They are hyperactive for 6-9 h after receiving L-DOPA and become hypoactive thereafter. Because these animals can be tested in the presence or absence of DA, they were used to determine whether DA is necessary for learning to occur. DD mice > were tested for learning to swim to an escape platform in a straight alley in the presence (30 min after an L-DOPA injection) or absence (22-24 h after an L-DOPA injection) of dopamine. The groups were split 24 h later and retested 30 min or 22-24 h after their last L-DOPA injection. In the initial test, DD mice without dopamine showed no evidence of learning, whereas those with dopamine had a learning curve similar in slope to controls but significantly slower. A retest after 24 h showed that DD mice can learn and remember in the absence of dopamine, leading to the inference that the lack of dopamine results in a performance/motivational decrement that masks their learning competence for this relatively simple task.

That is: The mice were made so they couldn't manufacture dopamine naturally due to inability to make a precursor. Some were then given a dopamine precursor suplement they couldn't make that enabled them to make dopamine. These learnt almost as well as mice that could manufacture dopamine by themselves. So they showed that they could make the mice learn almost as well as those without damage by replacing something that was lost.

If this doesn't narrow down things enough, what more do you want?

timtyler01 January 2010 08:18:32PM2 points [-]

The dopamine and opiate mechanisms are rather tangled together in practice:

The following study tests the hypothesis that dopamine is an essential mediator of various opiate-induced responses:

http://www.nature.com/nature/journal/v438/n7069/full/nature04172.html

Matt_Simpson01 January 2010 06:27:57PM1 point [-]

My first thought: redundancy. Having multiple circuits for the same task means there is a higher probability that at least one of them is working. However, this doesn't explain the differences between the two circuits.

Larks01 January 2010 11:32:29PM4 points [-]

On a related note, it seems people do not use 'happy' and 'unhappy' as opposite, at least when they're referring to a whole life. Rather, happiness involves normative notions (a good life) whereas being unhappy is simply about endorphins.

http://experimentalphilosophy.typepad.com/experimental_philosophy/2009/12/can-.html

FrankAdamek02 January 2010 09:08:20PM1 point [-]

Culturally it may generally be considered too much of a blow to ever say someone is unhappy in general, or has an unhappy life. Or it may be too depressing for the people themselves to think, that the other person was unhappy, is unhappy, and will continue to be unhappy, rather than just happens to be unhappy now.

Larks03 January 2010 12:22:42AM1 point [-]

If that were true, we’d expect to see people more willing to pronounce a ‘happy’ verdict than a ‘sad’ verdict, but the link I posted suggests that people are willing to agree that the wholesome woman is unhappy if she thinks she is, but unwilling to say the superficial woman is happy, even though she thinks she is.

Vladimir_Nesov01 January 2010 07:19:31PM* 7 points [-]

Thus wanting (motivation) is near, liking (enjoyment) is far (dopamine is near, opioids are far!). If liking doesn't have the power to make you actually do things, its role is primarily in forming your beliefs about what you want, which leads to presenting good images of yourself to others with sincerity.

So far, this is not a disagreement with "revealed preferences" thought. The disagreement would come in value judgment, where instead of taking the side of wanting (as economists seem to), or the side of liking (naive view, or one the many varieties of moral ideologies), one carefully considers the virtues on case-to-case basis, being open to discard parts from either category. True preference is neither revealed nor felt.

benthamite01 January 2010 05:24:12PM* 8 points [-]

By definition, if you choose X over Y, then X is a higher utility option than Y. That means utility represents wanting and not liking. But good utilitarians (and, presumably, artificial intelligences) try to maximize utility. This correlates contingently with maximizing happiness, but not necessarily

You are equivocating on the term 'utility' here, as have so many other commenters before in this forum. In the first sentence above, 'utility' is used in the sense given to that term by axiomatic utility theory. When the preferences of an individual conform to a set of axioms, they can be represented by a 'utility function'. The 'utilities' of this individual are the values of that function. By contrast, when ethicists discuss utilitarianism, what they mean by 'utility' is either pleasure or good. The empirical studies you cite, therefore, do not pose problems for utility theory or utilitarianism. They only pose problems for the muddled view on which utility functions represent that which hedonistic utilitarians think we ought to maximize.

Tyrrell_McAllister01 January 2010 05:45:18PM1 point [-]

You are equivocating on the term 'utility' here, as have so many other commenters before in this forum.

That seems to me to be an unfair reading. Nowhere does Yvain say that he's using the axiomatic theory of utility. It's true that he writes, "By definition, if you choose X over Y, then X is a higher utility option than Y." However, this definition can hold in other theoretical frameworks besides axiomatic utility theory. In particular, the definition plausibly holds in the framework used by some ethical utilitarians. Yvain can therefore be read as using the same definition for utility throughout.

Yvain01 January 2010 05:56:48PM3 points [-]

I accept Benthamite's criticism as valid. It may not be obvious from the text, but in my mind I was definitely equivocating.

If we can't use preference to determine ethical utility, it makes ethical utilitarianism a lot harder, but that might be something we have to live with. I don't remember very much about Coherent Extrapolated Volition, but my vague memories say it makes that a lot harder too.

Eliezer_Yudkowsky01 January 2010 08:12:12PM7 points [-]

I observe that you might have caught this mistake earlier via this heuristic: "Using the phrase "by definition", anywhere outside of math, is among the most alarming signals of flawed argument I've ever found. It's right up there with "Hitler", "God", "absolutely certain" and "can't prove that"." I should probably rewrite "math" as "pure math" just to make this clearer.

Vladimir_Nesov01 January 2010 07:27:14PM* 0 points [-]

If we can't use preference to determine ethical utility, it makes ethical utilitarianism a lot harder [...]

The way "preference" tends to be used in this community (as a more general word for "utility", communicating the same idea without explicit reference to expected utility maximization), this isn't right either. The actual decisions should be higher in utility than their alternatives, it is preferable if they are higher utility, but the correspondence is far from being factual, let alone "by definition" (Re: "By definition, if you choose X over Y, then X is a higher utility option than Y"). One can go a fair amount from actions to revealed preference, but only modulo human craziness and stupidity.

dclayh01 January 2010 06:24:07PM* 6 points [-]

For the record, the actual Landsburg quote is

In one recent survey, 39 percent of New Yorkers said they would leave the city "if they could"! Every one of them was in New York on the day of the interview, so we know that at a minimum, 39 percent of New Yorkers lie to pollsters.

page 63 of his latest book The Big Questions.

Although I'm generally a big fan of Landsburg, this seems much more a case of confusion over what "leave the city" and "if you can" mean than one of lying.

Yvain01 January 2010 08:06:12PM1 point [-]

I was reading More Sex is Safer Sex, so he must like using this anecdote a lot.

spamham02 January 2010 03:23:46AM1 point [-]

Seems like a pretty large leap from certain simple behaviours of rats to the natural-language meaning of "wanting" and "liking". Far-reaching claims such as this one should have strong evidence. Why not give humans drugs selective for either system and ask them? (Incidentally, at least with the dopamine system, this has been done millions of times ;) The opioids are a bit trickier because activating mu receptors (e.g. by means of opiates) will in turn cause a dopamine surge, too)

(Yes, I should just read the paper for their rationale, but can't be bothered right now...)

Blueberry01 January 2010 06:30:39PM3 points [-]

The other problem here is distinguishing pleasure, fun, and happiness.

As I understand wireheading, it's equivalent to experiencing a lengthy orgasm. I would describe an orgasm as pleasurable, but it seems inaccurate to call it "fun", or to call the state of experiencing an orgasm as "happiness".

Dean03 February 2010 08:01:04AM0 points [-]

I was reading a free on line book "The Authoritarians" by Robert Altemeyer one of his many findings of studying fundamentalists authoritarian follower types is that many deal with the guilt of doing some thing morally wrong by asking God for forgiveness and then feel closer to "Much less guilty" then "Appreciably less guilty" it may not be a wire in the head but it should keep one from some suffering.

I also very much like Dan Gilbert's Ted talk on synthesizing happiness I use it all the time because "it really is not so bad" and "it turned out for the best"

giles_english12 January 2010 09:35:55AM0 points [-]

Does this liking/enjoying dichotomy explain the various flavours of erotic masochism?

ciphergoth12 January 2010 10:11:16AM* 1 point [-]

Speaking from my own experience, I worry a lot that I'm often drawn to play computer games for reasons other than enjoying them. I never worry this about SM.

pdf23ds12 January 2010 09:48:03AM* 1 point [-]

I think you mean the "enjoyment/motivation dichotomy" or the "wanting/liking dichotomy". Many sexual masochists report a sort of euphoria and dissociation that begins to arise after a certain amount of pain, which would seem to be a positive liking. Many also report a positive thrill from humiliation that might be considered to overwhelm the negative parts of the experience. (I think pretty much all report that if the same things were to happen in a non-role-playing situation, they would not like or enjoy them. But it's hard to test that.)

Peter_Twieg08 January 2010 01:38:45AM0 points [-]

I realize that I'm late to the game on this post, but I have to say that as economist, I found the take home point about revealed preference to be quite interesting, and it makes me wonder about the extent to which further neuroscience research will find systematic disjunctions in everyday circumstances between what motivates us and what gives us pleasure. Undoubtedly this would be leveraged into new sorts of paternalistic arguments... I'm guessing we'll need another decade or two before we have the neuropaternalist's equivalent of Nudge, however.

Comment deleted 02 January 2010 04:25:25AM[-]