Armok_GoB comments on The Blue-Minimizing Robot - Less Wrong

162 Post author: Yvain 04 July 2011 10:26PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (159)

You are viewing a single comment's thread. Show more comments above.

Comment author: Armok_GoB 05 July 2011 08:32:06AM *  2 points [-]

To avoid SEEING blue things. If the model is good enough for it it'd search out a mirror and laser it's own camera so that it could NEVER see a blue pixel again.

This can be modelled using human empathy by equating the sensation of seeing blue with pain. You don't care to minimize damage to your body (if it's not somehting that actually cripples you), but you care about not getting the signal about it happening, and your reaction to a pill that turned you masochist would be very different than your reaction to a murder pill.

Edit: huh? I am surprised that this is downvoted, and the most probable reason is that I'm wrong in some obvious way that I can't see, can someone please tell me how? (Or maybe my usage of empathy was interpreted way to literally. )