You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

Viliam_Bur comments on Trapping AIs via utility indifference - Less Wrong Discussion

3 Post author: Stuart_Armstrong 28 February 2012 07:27PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Article Navigation

Comments (32)
Tags: algorithm prediction safety risk mathematics ai indifference

Comments (32)

You are viewing a single comment's thread. Show more comments above.

Comment author: Viliam_Bur 29 February 2012 09:33:07AM 0 points [-]

Torture in 1 world where the Evil AI is released, but removing more than dust specks in the remaining worlds? Just give me the parchment that I can sign with my blood! :D

And by the way, how will we check whether the produced code is really a friendly AI?

Comment author: Armok_GoB 29 February 2012 10:56:45AM 0 points [-]

We can't. And even an AI with no terminal values in other branches will still want to control them in order to increase utility in the branch it does through various indirect means, such as conterfactual trade, if that's cheap, which it will be in any setup a human can think of.

Powered by Reddit Powered by Reddit