John_Maxwell_IV comments on Stupid Questions Thread - January 2014 - Less Wrong

10 Post author: RomeoStevens 13 January 2014 02:31AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (293)

You are viewing a single comment's thread. Show more comments above.

Comment author: John_Maxwell_IV 15 January 2014 05:44:51AM *  7 points [-]

MIRI failure modes that all seem likely to me:

  • They talk about AGI a bunch and end up triggering an AGI arms race.

  • AI doesn't explode the way they talk about, causing them to lose credibility on the importance of AI safety as well. (Relatively slow-moving) disaster ensues.

  • The future is just way harder to predict than everyone thought it would be... we're cavemen trying to envision the information age and all of our guesses are way off the mark in ways we couldn't have possibly forseen.

  • Uploads come first.