I'm sure the engineers knew exactly what would happen.
Why?
I wonder.
It seems like something that could be easily anticipated, and even tested for.
Yet a lot of people just don't take a game theoretic look at problems, and have a hard time conceiving of people with different motivations than they have.
http://www.wired.com/2016/03/fault-microsofts-teen-ai-turned-jerk/
Could this be a lesson for future AIs? The AI control problem?
[future AIs may be shutdown, and matyred..]