benelliott comments on Why No Wireheading? - Less Wrong

16 [deleted] 18 June 2011 11:33PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (112)

You are viewing a single comment's thread.

Comment author: timtyler 19 June 2011 08:42:44AM 3 points [-]

Can someone give a reason why wireheading would be bad?

Well, we don't want our machines to wirehead themselves. If they do, they are less likely to be interested in doing what we tell them to - which would mean that they are then less use to us.

Comment author: [deleted] 19 June 2011 01:53:14PM 1 point [-]

Sure, but what about us?

As designers, we have good reasons to find a way around wireheading (and somewhat less seriously and metaphorically, Azathoth has good reasons to prevent us from wireheading). So making wireheading-proof agents is important, I agree, but that doesn't apply to ourselves.

Comment author: byrnema 19 June 2011 02:43:53PM 2 points [-]

The connection with us could be that (to the extent we can) we choose what we want as though we were machines at our disposal.

... There is a component that wants doughnuts for breakfast, but actually "I" want eggs for breakfast since I'd rather be healthy ... and the machine that is me obstensibly makes eggs. The hedeonistic component of our brain that wants wire-heading is probably/apparently repressed when it comes down to conflicts with real external goals.