RichardKennaway comments on The Blue-Minimizing Robot - Less Wrong

162 Post author: Yvain 04 July 2011 10:26PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (159)

You are viewing a single comment's thread. Show more comments above.

Comment author: Khaled 07 July 2011 09:52:15AM 3 points [-]

Without overfitting, the robot has the goal of shooting at what it sees blue. It achieves its goal. What I get from the article is that the human intelligence mis interprets the goal. Here I see the definition of a goal to equal what the program is written to do, hence it seems inevitable that the robot wll achieve its goal (if there is a bug in the code that misses shooting a blue object every 10 days, then this should be considered part of the goal as well, since we are forced to define the goal in hindsight, if we have to define one)

Comment author: MugaSofer 10 January 2013 11:55:45AM -2 points [-]

Do you reason similarly for humans?

Comment author: RichardKennaway 10 January 2013 01:19:28PM 1 point [-]

It is almost proverbial that intentions are better revealed by deeds than by words.

Comment author: MugaSofer 10 January 2013 01:38:31PM *  -2 points [-]

You're right. Man, I can't believe I've been wasting my time persuading people to sign up for cryonics, because if they wanted to live, they would have already done so! I can't believe I didn't realize this before.