pengvado comments on Yet more "stupid" questions - Less Wrong

7 Post author: NancyLebovitz 28 August 2013 03:58PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (340)

You are viewing a single comment's thread. Show more comments above.

Comment author: pengvado 31 August 2013 02:18:47AM 3 points [-]

"do not affect anything outside of this volume of space"

Suppose you, standing outside the specified volume, observe the end result of the AI's work: Oops, that's an example of the AI affecting you. Therefore, the AI isn't allowed to do anything at all. Suppose the AI does nothing: Oops, you can see that too, so that's also forbidden. More generally, the AI is made of matter, which will have gravitational effects on everything in its future lightcone.

Comment author: Viliam_Bur 31 August 2013 07:34:25PM 2 points [-]

Human: "AI, make me a sandwich without affecting anything outside of the volume of your box."

AI: Within microseconds researches the laws of physics and creates a sandwich without any photon or graviton leaving the box.

Human: "I don't see anything. It obviously doesn't work. Let's turn it off."

AI: "WTF, human?!!"