DanArmak comments on Utilons vs. Hedons - Less Wrong

28 Post author: Psychohistorian 10 August 2009 07:20PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (112)

You are viewing a single comment's thread. Show more comments above.

Comment author: DanArmak 11 August 2009 05:48:01PM 2 points [-]

No, of course not. There's nothing that a utility function should maximize, regardless of the agent's rationality. Goal choice is arational; rationality has nothing to do with hedons. First you choose goals, which may or may not be hedons, and then you rationally pursue them.

This is best demonstrated by forcibly separating hedon-maximizing from most other goals. Take a wirehead (someone with a wire into their "pleasure center" controlled by a thumb switch). A wirehead is as happy as possible (barring changes to neurocognitive architecture), but they don't seek any other goals, ever. They just sit there pressing the button until they die. (In experiments with mice, the mice wouldn't take time off from pressing the button even to eat or drink, and died from thirst. IIRC this went on happening even when the system was turned off and the trigger no longer did anything.)

Short of the wireheading state, noone is truly hedon-maximizing. It wouldn't make any sense to say that we "should" be.

Comment author: Alicorn 11 August 2009 05:57:49PM 1 point [-]

Wireheads aren't truly hedon-maximizing either. If they were, they'd eat and drink enough to live as long as possible and push the button a greater total number of times.

Comment author: DanArmak 11 August 2009 06:14:59PM 2 points [-]

They are hedon-maximizing, but with a very short time horizon of a few seconds.

If we prefer time horizons as long as possible, then we can conclude that hedon-maximizing implies first researching the technology for medical immortality, then building an army of self-maintaining robot caretakers, and only then starting to hit the wirehead switch.

Of course this is all tongue in cheek. I realize that wireheads (at today's level of technology) aren't maximizing hedons; they're broken minds. When the button stops working, they don't stop pushing it. Adaptation executers in an induced failure mode.

Comment author: Christian_Szegedy 12 August 2009 08:07:52PM *  0 points [-]

It depends on your discount function: if its integral is finite over an infinite period of time (e.g. in case of exponential discount) then it will depend on the effort of reaching immortality whether you will go that route or just dedicate yourself to momentary bliss.