Perplexed comments on AI that doesn't want to get out - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Loading…
Subscribe to RSS Feed
Powered by Reddit
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (16)
Sounds safe to me. The AI you describe is not going to FOOM or do anything dangerous.
On the other hand, it is probably not going to cure AIDS, either.
Building an AI that is guaranteed not to FOOM is not that difficult (assuming you know how to build an AI). The trick is to get an AI that does FOOM, but does so in a safe and friendly way.
Why do we want our AI to FOOM? Because if ours doesn't, someone else's will.
It would have to get far enough ahead to put others out of business - though that may not necessarily mean terribly fast development, or a terribly high level of development. From there progress could take place at whatever rate was deemed desirable.