Less Wrong is a community blog devoted to refining the art of human rationality. Please visit our About page for more information.

saturn comments on AI that doesn't want to get out - Less Wrong

-4 Post author: Tiiba 27 March 2011 04:16AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (16)

You are viewing a single comment's thread.

Comment author: saturn 27 March 2011 07:56:58AM 8 points [-]

The idea of not affecting anything except this or that is a concept that only exists in fuzzy human folk ontology; physics doesn't really work that way. You would essentially be instructing the AI not to exist.

Stated in more detail here.

Comment author: Tiiba 27 March 2011 08:50:41AM 0 points [-]

It's allowed to produce waste heat. I see no reason to let it make anything else. I know it can't actially cut itself off from the universe, but it shouldn't enjoy this fact.

Comment author: benelliott 27 March 2011 10:01:31AM 3 points [-]

Unfortunately it can't even limit itself to this. Every object with mass exerts a gravitational attraction on every other object, it can't help but affect the world outside through these means as well, so we have to allow it to do so, which may result in disaster for all we know. We also have to allow some radiation out, since this is also unavoidable. At this point I should point out that detonating a nuclear warhead can probably be fit into the category of "emitting waste heat and radiation".

Comment author: Tiiba 27 March 2011 04:59:04PM 0 points [-]

I did mention explosions. And gravity? I don't see what it could do with gravity. Although I see that it could do something with vibration.