Viliam comments on [Link] Introducing OpenAI - Less Wrong

23 Post author: Baughn 11 December 2015 09:54PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (48)

You are viewing a single comment's thread. Show more comments above.

Comment author: Viliam 14 December 2015 12:08:51PM *  2 points [-]

It will be probably much easier to use the AI against someone secretly.

You could try to drop an atomic bomb on someone without them knowing who dropped the bomb on them. But you cannot drop an atomic bomb on them without them knowing that someone dropped the bomb on them.

But you could give your AI a task to invent ways how to move things closer to your desired outcome without creating suspicion. The obvious options would be to make it happen as a "natural" outcome, or to cast the suspicion on someone else, or maybe try to reach the goal in a way that will make people believe it didn't happen or that it wasn't your goal at all. (A superhuman AI could find yet more options; some of them could be incomprehensive to humans. Also options like: the whole world turns into utter chaos; by the way your original goal is completed, but everyone is now too busy and too confused to even notice it or care about it.) How is anyone going to punish that?