RichardKennaway comments on The Blue-Minimizing Robot - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (159)
Without overfitting, the robot has the goal of shooting at what it sees blue. It achieves its goal. What I get from the article is that the human intelligence mis interprets the goal. Here I see the definition of a goal to equal what the program is written to do, hence it seems inevitable that the robot wll achieve its goal (if there is a bug in the code that misses shooting a blue object every 10 days, then this should be considered part of the goal as well, since we are forced to define the goal in hindsight, if we have to define one)
Do you reason similarly for humans?
It is almost proverbial that intentions are better revealed by deeds than by words.
You're right. Man, I can't believe I've been wasting my time persuading people to sign up for cryonics, because if they wanted to live, they would have already done so! I can't believe I didn't realize this before.