Hurricanes act with 'violence' in the sense of destructive power, but hurricanes don't hate people. The idea is that an AGI, like an intelligent hurricane, can be dangerous without bearing any special animosity for humans, indeed without caring or thinking about humans in any way whatsoever.
The idea is that an AGI, like an intelligent hurricane, can be dangerous without bearing any special animosity for humans, indeed without caring or thinking about humans in any way whatsoever.
No. That's not what he said. There's a difference between claiming that A can be dangerous without X and claiming that a scenario that A can be dangerous due to X.
There more than one plausible UFAI scenario. We do have discussions about boxing AI and in those cases it's quite useful to model the AI as trying to act against humans to get out.
There's a big Hollywood movie coming out with an apocalyptic Singularity-like story, called Transcendence. (IMDB, Wiki, official site) With an A-list cast and big budget, I contend this movie is the front-runner to be 2014's most significant influence on discussions of superintelligence outside specialist circles. Anyone hoping to influence those discussions should start preparing some talking points.
I don't see anybody here agree with me on this. The movie has been briefly discussed on LW when it was first announced in March 2013, but since then, only the trailer (out since December) has been mentioned. MIRI hasn't published a word about it. This amazes me. We have three months till millions of people who never considered superintelligence are going to start thinking about it - is nobody bothering to craft a response to the movie yet? Shouldn't there be something that lazy journalists, given the job to write about this movie, can find?
Because if there isn't, they'll dismiss the danger of AI like Erik Sofge already did in an early piece about the movie for Popular Science, and nudge their readers to do so too. And that'd be a shame, wouldn't it?