RobinZ comments on Morality as Parfitian-filtered Decision Theory? - Less Wrong

24 Post author: SilasBarta 30 August 2010 09:37PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (270)

You are viewing a single comment's thread.

Comment author: RobinZ 31 August 2010 12:02:19PM *  2 points [-]

Parenthood doesn't look like a Parfait's Hitchhiker* to me - are you mentioning it for some other reason?

* Err, Parfit's Hitchhiker. Thanks, Alicorn!

Edit: I have updated my position downthread.

Comment author: gwern 31 August 2010 01:26:45PM 3 points [-]

The researchers wrote up their findings on the lottery winners and the accident victims in the Journal of Personality and Social Psychology. The paper is now considered one of the founding texts of happiness studies, a field that has yielded some surprisingly morose results. It’s not just hitting the jackpot that fails to lift spirits; a whole range of activities that people tend to think will make them happy—getting a raise, moving to California, having kids—do not, it turns out, have that effect. (Studies have shown that women find caring for their children less pleasurable than napping or jogging and only slightly more satisfying than doing the dishes.)

http://www.newyorker.com/arts/critics/books/2010/03/22/100322crbo_books_kolbert?currentPage=all

(Glad I kept this citation; knew at some point I would run into someone claiming parenthood is a joy. Wish I had the one that said parenthood was a net gain in happiness only years/decades later after the memories have been distorted enough.)

Comment author: simplicio 01 September 2010 03:53:28AM *  6 points [-]

The basic idea about parents and hedonic psychology, as I understand it, is that your moment-to-moment happiness is not typically very high when you have kids, but your "tell me a story" medium/long term reflective happiness may be quite high.

Neither of those is privileged. Have you ever spent a day doing nothing but indulging yourself (watching movies, eating your favourite foods, relaxing)? If you're anything like me you find that even thought most moments during the day were pleasant, the overall experience of the day was nasty and depressing.

Basically, happiness is not an integral of moment-to-moment pleasure, so while it's naive to say parenting is an unqualified joy, it's not so bleak as to be only a good thing after the memories are distorted by time.

Comment author: a_parent 01 September 2010 04:40:25AM 2 points [-]

As a parent I can report that most days my day-wise maximum moment-to-moment happiness is due to some interaction with my child.

But then, my child is indisputably the most lovable child on the planet. </parental preening>

(welcome thread link not necessary)

Comment author: simplicio 01 September 2010 05:05:42AM 1 point [-]

Then let me just say, welcome!

As a parent I can report that most days my day-wise maximum moment-to-moment happiness is due to some interaction with my child.

I'm inclined to believe you, but note that what you said doesn't quite contradict the hypothesis, which is that if you were not a parent, your day-wise maximum (from any source) would probably be higher.

Also, beware of attributing more power to introspection than it deserves, especially when the waters are already muddied by the normativity of parents' love for their children. You say your happiest moments are with your child, but a graph of dopamine vs. time might (uninspiringly) show bigger spikes whenever you ate sugar. Or it might not. My point is that I'm not sure how much we should trust our own reflections on our happiness.

Comment author: a_parent 01 September 2010 02:13:44PM 4 points [-]

note that what you said doesn't quite contradict the hypothesis

Fair point. So let me just state that as far as I can tell, the average of my DWMM2M happiness is higher than it was before my child was born, and I expect that in a counterfactual world where my spouse and I didn't want a child and consequently didn't have one, my DWMM2M happiness would not be as great as in this one. It's just that knowing what I know (including what I've learned from this site) and having been programmed by evolution to love a stupendous badass (and that stupendous badass having been equally programmed to love me back), I find that watching that s.b. unfold into a human before my eyes causes me happiness of a regularity and intensity that I personally have never experienced before.

Comment author: gwern 01 September 2010 12:55:20PM 1 point [-]

My point is that I'm not sure how much we should trust our own reflections on our happiness.

I would mischievously point out things like the oxytocin released after childbirth ought to make us especially wary of bias when it comes to kids. After all, there is no area of our life that evolution could be more concerned about than the kids. (Even your life is worth less than a kid or two, arguably, from its POV.)

Comment author: a_parent 01 September 2010 02:14:19PM 2 points [-]

That oxytocin &c. causes us to bond with and become partial to our children does not make any causally subsequent happiness less real.

Comment author: gwern 01 September 2010 02:31:01PM -1 points [-]

So, then, you would wirehead? It seems to me to be the same position.

Comment author: a_parent 01 September 2010 03:33:09PM 4 points [-]

I wouldn't: I have preferences about the way things actually are, not just how they appear to me or what I'm experiencing at any given moment.

Comment author: gwern 01 September 2010 04:35:17PM 0 points [-]

So that use of oxytocin (and any other fun little biases and sticks and carrots built into us) is a 'noble lie', justified by its results?

In keeping with the Niven theme, so, then you would not object to being tasped by a third party solicitous of your happiness?

Comment author: simplicio 01 September 2010 11:53:49PM *  2 points [-]

It seems to me to be the same position.

Hm... not obviously so. Any reductionist explanation of happiness from any source is going to end up mentioning hormones & chemicals in the brain, but it doesn't follow that wanting happiness (& hence wanting the attendant chemicals) = wanting to wirehead.

I struggle to articulate my objection to wireheading, but it has something to do with the shallowness of pleasure that is totally non-contingent on my actions and thoughts. It is definitely not about some false dichotomy between "natural" and "artificial" happiness; after all, Nature doesn't have a clue what the difference between them is (nor do I).

Comment author: gwern 02 September 2010 12:56:51PM 0 points [-]

It is definitely not about some false dichotomy between "natural" and "artificial" happiness; after all, Nature doesn't have a clue what the difference between them is (nor do I).

Certainly not, but we do need to understand utility functions and their modification; if we don't, then bad things might happen. For example (I steal this example from EY), a 'FAI' might decide to be Friendly by rewiring our brains to simply be really really happy no matter what, and paperclip the rest of the universe. To most people, this would be a bad outcome, and is an intuitive argument that there are good and bad kinds of happiness, and the distinctions probably have something to do with properties of the external world.

Comment author: xamdam 31 August 2010 04:39:11PM *  3 points [-]

I'm not going to claim having children is "rational", but to judge it by the happiness of "caring for children" is about the same as to judge quality of food by enjoyment of doing the dishes. This is very one-dimensional.

Moreover I actually think it's foolish to use any kind of logical process (such as reading this study) to make decisions in this area except for extreme circumstances such as not having enough money or having genetic diseases.

The reason for my attitude is that I think besides the positive upsides to having kids (there are many, if you're lucky) there is a huge aspect of regret minimization involved; it seems to me Nature choose stick rather than a carrot here.

ETA: I should perhaps say short-term carrot and a long term stick

Comment author: RobinZ 31 August 2010 04:06:58PM 1 point [-]

I wasn't proposing that parenthood is a joy - I may have misunderstood what SilasBarta meant by "utility function places positive weight".

Comment author: SilasBarta 01 September 2010 03:55:54PM 0 points [-]

"Utility function of agent A places positive weight on X" is equivalent to "A regards X as a terminal value".

Comment author: Alicorn 31 August 2010 12:41:38PM 1 point [-]

Parfait's Hitchhiker

Now I'm trying to figure out how a parfait could drive a car.

Comment author: gwern 31 August 2010 01:26:57PM 5 points [-]

Deliciously.

Comment author: SilasBarta 01 September 2010 02:01:37PM 2 points [-]

From the Simpsons: "We would also have accepted 'snacktacularly'."

(For our non-native readers: snacktacular = snack + spectacular.)

Comment author: Pavitra 31 August 2010 05:23:26PM 1 point [-]
Comment author: PhilGoetz 31 August 2010 07:15:57PM 1 point [-]

Now I want a parfait.

Comment author: SilasBarta 31 August 2010 05:55:22PM 1 point [-]

Natural selection is the Omega, and the mind propagated through generations by natural selection is the hitchhiker. The mind only gets to the "decide to pay"/"decide to care for children" if it had the right decision theory before the "rescue"/"copy to next generation".

Does it look similar now?

Comment author: RobinZ 01 September 2010 01:16:05PM 1 point [-]

I see the parallelism. If you ask me, though, I would say that it's not a Parfitian filter, but a prototypical example of a filter to demonstrate that the idea of a filter is valid.

Comment author: SilasBarta 01 September 2010 01:55:44PM 0 points [-]

What's the difference?

Comment author: RobinZ 01 September 2010 02:11:37PM 0 points [-]

Perhaps I am being obtuse. Let me try to articulate a third filter, and get your reasoning on whether it is Parfitian or not.

As it happens, there exist certain patterns in nature which may be reliably counted upon to correlate with decision-theory-relevant properties. One example is the changing color of ripening fruit. Now, species with decision theories that attribute significance to these patterns will be more successful at propagating than those that do not, and therefore will be more widespread. This is a filter. Is it Parfitian?

Comment author: SilasBarta 01 September 2010 02:28:40PM 1 point [-]

No, because a self-interested agent could regard it as optimal to judge based on that pattern by only looking at causal benefits (CaMELs) to itself. In contrast, an agent could only regard it as optimal to care for offspring (to the extent we observe in parents) based on considering SAMELs, or having a utility function contorted to the point that its actions could more easily be explained by reference to SAMELs.

Comment author: RobinZ 01 September 2010 04:07:22PM *  1 point [-]

Let me try to work this out again, from scratch. A Parfit's hitchhiking involves the following steps in order:

  1. Omega examines the agent.
  2. Omega offers the agent the deal.
  3. The agent accepts the deal.
  4. Omega gives the agent utility.
  5. The agent gives Omega utility.

Parenthood breaks this chain in two ways: first, the "Omega" in step 2 is not the "Omega" in step 4, and neither of these are the "Omega" in step 5; and second, step 1 never occurs. Remember, "natural selection" isn't an agent - it's a process, like supply and demand, that necessarily happens.

Consider, for contrast, division of labor. (Edit: The following scenario is malformed. See followup comment, below.) Let's say that we have Ag, the agent, and Om, the Omega, in the EEA. Om wants to hunt, but Om has children.

  1. Om examines Ag and comes to the conclusion that Ag will cooperate.
  2. Om asks Ag to watch Om's children while on the hunt, in exchange for a portion of the proceeds.
  3. Ag agrees.
  4. Ag watches Om's children while Om hunts.
  5. Om returns successful, and gives Ag a share of the bounty.

Here, all five steps occur in order, Om is Om throughout and Ag is Ag throughout, and both Om and Ag gain utility (meat, in this case) by the exchange.

Does that clarify our disagreement?

Comment author: SilasBarta 01 September 2010 04:37:49PM *  1 point [-]

Does that clarify our disagreement?

Somewhat, but I'm confused:

  • Why does it matter that the Omegas are different? (I dispute that they are, but let's ignore that for now.) The parallel only requires functional equivalence to "whatever Omega would do", not Omega's identity persistence. (And indeed Parfit's other point was that the identity distinction is less clear than we might think.)
  • Why does it matter that natural selection isn't an agent? All that's necessary is that it be an optimization process -- Omega's role in the canonical PH would be no different if it were somehow specified to "just" be an optimization process rather than an agent.
  • What is the purpose of the EEA DoL example? It removes a critical aspect of PH and Parfitian filters -- that optimality requires recognition of SAMELs. Here, if Ag doesn't watch the children, Om sees this and can withhold the share of the bounty. If Ag could only consider CaMELs (and couldn't have anything in its utility function that sneaks in recognition of SAMELs), Ag would still see why it should care for the children.
  • (Wow, that's a lot of abbreviations...)
Comment author: RobinZ 01 September 2010 09:24:52PM 0 points [-]

Taking your objections out of order:

First: yes, I have the scenario wrong - correct would be to switch Ag and Om, and have:

  1. Om examines Ag and comes to the conclusion that Ag will cooperate.
  2. Om offers to watch Ag's children while Ag hunts, in exchange for a portion of the proceeds.
  3. Ag agrees.
  4. Om watches Ag's children while Ag hunts.
  5. Ag returns successful, and gives Om a share of the bounty.

In this case, Om has already given Ag utility - the ability to hunt - on the expectation that Ag will give up utility - meat - at a later time. I will edit in a note indicating the erroneous formulation in the original comment.

Second: what we are comparing are cases where an agent gives no utility to cooperating with Omega, but uses a decision theory that does so because it boosts the agent's utility (e.g. the prototypical case) and cases where the agent gives positive utility to cooperating with Omega (e.g. if the agent and Omega were the same person and the net change is sufficiently positive). What we need to do to determine if the isomorphism with Parfit's hitchhiker is sufficient is to identify a case where the agent's actions will differ.

It seems to me that the latter case, the agent will give utility to Omega even if Omega never gives utility to the agent. Parfit's hitchhikers do not give money to Nomega, the predictor agent who wasn't at the scene and never gave them a ride - they only give money when the SAMEL is present. Therefore: if a parent is willing to make sacrifices when their parent didn't, the Parfit parallel is poor and Theory 2a is the better fit. Agreed?

Comment author: SilasBarta 01 September 2010 10:19:32PM 0 points [-]

I'm not sure I understand all the steps in your reasoning, but I think I can start by responding to your conclusion:

Therefore: if a parent is willing to make sacrifices when their parent didn't, the Parfit parallel is poor and Theory 2a is the better fit. Agreed?

As best I can understand you, yes. If there's e.g. a species that does not care for its young, then one day, one of them does, that action would not be best explained by its recognition (or acting as it if had recognition) of a SAMEL (because there was no "AM") -- it would have to be chalked up to some random change in its psychology.

However -- and this is the important part -- by making that choice, and passing the genes partly responsible for that choice, into the next generation, it opens up the possibility of exploring a new part of the "organism design space": the part which which is improved my modifications predicated on some period of parent-child care [1].

If that change, and further moves into that attractor [2], improve fitness, then future generations will care for their children, with the same psychological impetus as the first one. They feel as if they just care about their children, not that they have to act on a SAMEL. However, 2b remains a superior explanation because it makes fewer assumptions (except for the organism to first have the mutation, which is part of the filter); 2b needn't assume that the welfare of the child is a terminal value.

And note that the combined phenomena do produce functional equivalence to recognition of a SAMEL. If the care-for-children mode enhances fitness, then it is correct to say, "If the organism in n-th generation after mutation did not regard it as optimal to care for the (n+1)th generation, it would not be here", and it is correct to say that that phenomenon is responsible for the organism's decision (such as it is a decision) to care for its offspring. Given these factors, an organism that chooses to care for its offspring is acting equivalently to one motivated by the SAMEL. Thus, 2b can account for the same behavior with fewer assumptions.

As for the EEA DoL arrangement (if the above remarks haven't screened off the point you were making with it): Om can still, er, withhold the children. But let's ignore that possibility on grounds of Least Convenient Possible World. Even so, there are still causal benefits to Ag keeping up its end -- the possibility of making future such arrangements. But let's assume that Ag can still come out ahead by stiffing Om.

In that case, yes, Ag would have to recognize SAMELs to justify paying Om. I'd go on to make the normal point about Ag having already cleaved itself off into the world where there are fewer Om offers if it doesn't see this SAMEL, but honestly, I forgot the point behind this scenario so I'll leave it at that.

(Bitter aside: I wish more of the discussion for my article was like this, rather than being 90% hogged by unrelated arguments about PCT.)

[1] Jaron Lanier refers to this replication mode as "neoteny", which I don't think is the right meaning of the term, but I thought I'd mention it because he discussed the importance of a childhood period in his manifesto that I just read.

[2] I maybe should have added in the article that the reasoning "caring for children = good for fitness" only applies to certain path-dependent domains of attraction in the design space, and doesn't hold for all organisms.

Comment author: pjeby 31 August 2010 06:02:34PM *  0 points [-]

Natural selection is the Omega, and the mind propagated through generations by natural selection is the hitchhiker. The mind only gets to the "decide to pay"/"decide to care for children" if it had the right decision theory before the "rescue"/"copy to next generation".

You should put that in the article. (True, it's a causal iteration rather than an acausal prediction. But it'll still make the article clearer.)

Comment author: SilasBarta 31 August 2010 06:12:09PM 0 points [-]

Thanks for the suggestion, I've added it.

Comment author: Snowyowl 31 August 2010 01:43:42PM 1 point [-]

Consider this situation: You are given the choice between personally receiving a small prize or giving your children a much larger prize. Whatever you choose, it is possible that your children will one day face a similar choice. Being your children, they resemble you in many ways and are more likely than not to choose similarly to you. Its not quite a Parfit's Hitchhiker even from your childrens' perspective - the consequences of their choice are in the past, not the future - but it's close, and the result is the same.

Comment author: RobinZ 31 August 2010 04:10:25PM 0 points [-]

I see what you mean, but I think the parallel is pretty weak.