wedrifid comments on The Blue-Minimizing Robot - Less Wrong

162 Post author: Yvain 04 July 2011 10:26PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (159)

You are viewing a single comment's thread. Show more comments above.

Comment author: Decius 03 February 2013 12:40:43AM 0 points [-]

Why would a dumb 'minimize blue' robot search for blue things?

Current condition: I see no blue things.
Expected result of searching for blue things: There are more blue things.
Expected result of not searching for blue things: There are no blue things.

Where 'blue' is defined as 'eliciting a defined response from the camera'. Nothing outside the view of the camera is blue by that definition.

Comment author: wedrifid 03 February 2013 01:18:02AM 0 points [-]
  • Expected result of searching for blue things: There are more blue things.
  • Expected result of not searching for blue things: There are no blue things.

A "dumb robot" is assumed to be a weak optimizer. It isn't defined to be actively biased and defective in known ways related to the human experience 'denial'. Sure you can come up with specific ways that an optimizer could be broken and draw conclusions about what that particular defective robot will do. But these don't lead to a conclusion where it makes sense to rhetorically imply the inconceivability of a robot that doesn't have that particular bug.

Comment author: Decius 03 February 2013 01:47:37AM -1 points [-]

I'm putting 'dumb' at roughly the level of cognition of a human infant, lacking object permanence. Human toddler intelligence counts as 'smart'. I'm considering a strict reward system: negatrons added proportional to the number of blue objects detected.

Comment author: wedrifid 03 February 2013 01:55:11AM *  0 points [-]

I'm putting 'dumb' at roughly the level of cognition of a human infant

Then, as per the grandparent, the answer to the rhetorical question "Why would a dumb 'minimize blue' robot search for blue things?" is because it doesn't happen to be a robot designed with the exact same peculiarities and weaknesses of a human infant.

Comment author: Decius 03 February 2013 10:32:38PM -1 points [-]

Lack of object permanence isn't a peculiar weakness. The ability to spontaneously leave Plato's cave is one of the things that I reserve for 'smart' actors as opposed to 'dumb' ones.