TheAncientGeek comments on Will AGI surprise the world? - Less Wrong

12 Post author: lukeprog 21 June 2014 10:27PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (129)

You are viewing a single comment's thread. Show more comments above.

Comment author: XiXiDu 22 June 2014 09:20:19AM *  1 point [-]

Nobody was ever tempted to say, "But as the nuclear chain reaction grows in power, it will necessarily become more moral!"

We became better at constructing nuclear power plants, and nuclear bombs became cleaner. What critics are saying is that as AI advances, our control over it advances as well. In other words, the better AI becomes, the better we become at making AI work as expected. Because if AI became increasingly unreliable as its power grew, AI would cease to be a commercially viable product.

Comment author: TheAncientGeek 22 June 2014 10:10:35AM 2 points [-]

That's one of the standard responses to the MIRI argument, but not the same as the Artificial Philosopher response. I call it the SIRI versus MIRI response.