Anja comments on A definition of wireheading - Less Wrong

35 Post author: Anja 27 November 2012 07:31PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (80)

You are viewing a single comment's thread. Show more comments above.

Comment author: Anja 29 November 2012 11:36:37PM 0 points [-]

You are a wirehead if you consider your true utility function to be genetic fitness.

Comment author: DanArmak 30 November 2012 05:59:36PM 4 points [-]

What makes a utility function "true"? If I choose to literally wirehead - implant electrodes - I can sign a statement saying I consider my "true" utility function to be optimized by wireheading. Does that mean I'm not wireheading in your sense?

Comment author: timtyler 06 December 2012 12:40:11AM 0 points [-]

You are a wirehead if you consider your true utility function to be genetic fitness.

Not according to most existing usage of the term.

Comment author: brazil84 30 November 2012 08:50:10AM -1 points [-]

Well what else could it be? :)

Comment author: AlexSchell 01 December 2012 05:15:32AM 0 points [-]

Humans are adaptation-executers, not fitness-maximizers. A mother's love of her child enters into her utility function independently of her desire to maximize inclusive fitness, even though the relevant neuroanatomy is the result of an optimization process maximizing only inclusive fitness.

Comment author: soreff 02 December 2012 03:01:28AM 0 points [-]

Is that descriptive or normative?

Comment author: AlexSchell 02 December 2012 06:53:47AM 0 points [-]

Purely descriptive. On a broadly subjectivist metaethics, it also has normative implications.

Comment author: brazil84 01 December 2012 10:09:56AM 0 points [-]

Well fine, but what if somebody decides to execute his adaptation by means of direct stimulation of the brain center in question. Surely that counts as wireheading, no?

Comment author: AlexSchell 02 December 2012 06:51:51AM *  1 point [-]

I eiher don't understand your hypothetical or you didn't understand the linked post.

But I'll try: if you're talking about an agent whose utility function really specifies stimulating one's brain with contraptions involving wires (call this wireheading#) as a terminal value [ETA: or, more plausibly, specifies subjective pleasure as a terminal value], then their wireheading# activities are not [ETA: necessarily] wireheading as discussed here, it seems to me.

Comment author: brazil84 02 December 2012 02:29:57PM 0 points [-]

Let's do this: Can you give me a few examples of human behavior which you see as execution of adaptations?