You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

djm comments on Examples of AI's behaving badly - Less Wrong Discussion

25 Post author: Stuart_Armstrong 16 July 2015 10:01AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (35)

You are viewing a single comment's thread. Show more comments above.

Comment author: gjm 16 July 2015 12:38:43PM 14 points [-]

Another, famous, example. At one time, somewhere in India there were a lot of cobras, which are dangerous. So the government (it happened to be the British Raj at the time) decided to offer a bounty for dead cobras. That worked for a while, until people figured out that they could breed cobras for the bounty. Then the government worked out what was going on, and cancelled the bounty. So then the cobra breeders released all their now-valueless cobras into the wild.

(According to Wikipedia this particular instance isn't actually well documented, but a similar one involving rats in Hanoi is.)

Comment author: Val 18 July 2015 01:03:03PM 4 points [-]

This effect also exists in software development:

http://thedailywtf.com/articles/The-Defect-Black-Market

Comment author: gjm 18 July 2015 03:44:34PM 2 points [-]

Famous Dilbert cartoon on this topic.