Dmytry comments on Superintelligent AGI in a box - a question. - Less Wrong

14 Post author: Dmytry 23 February 2012 06:48PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (77)

You are viewing a single comment's thread. Show more comments above.

Comment author: Dmytry 26 February 2012 08:59:47AM *  1 point [-]

Man, you're restarting a very cooperative AI here.

My example unfriendly AI thinks all the way to converting universe to computronium well before it figures out it might want to talk to you and translate things to accomplish that goal by using you somehow. It just doesn't translate things for you unless your training data gives it enough cue about universe.

WRT being able to confirm what it's doing, say, I make neural network AI. Or just what ever AI that is massively parallel.