= 27d567bc2d48d9f40e9ccc20ea370b15)
V_V comments on Rationality Quotes August 2012 - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
= 783df68a0f980790206b9ea87794c5b6)
Loading…= b715d02e85f7b3b4ae65ca3d3e450868)
Subscribe to RSS Feed
Powered by Reddit
= f037147d6e6c911a85753b9abdedda8d)
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (426)
Humans reading computer code aren't gods either. How long until an uFAI would get caught if it did stuff like this?
Even if the AI can modify its code, it can't really do anything that wasn't entailed by its original programming.
(Ok, it could have a security vulnerability that allowed the execution of externally-injected malicious code, but that is a general issue of all computer systems with an external digital connection)
The hard part is predicting everything that was entailed by its initial programing and making sure it's all safe.
That's right, history of engineering tells us that "provably safe" and "provably secure" systems fail in unanticipated ways.