ESRogs comments on The Friendly AI Game - Less Wrong

38 Post author: bentarm 15 March 2011 04:45PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (170)

You are viewing a single comment's thread. Show more comments above.

Comment author: ESRogs 03 May 2012 12:46:48AM 0 points [-]

Defining the metric for cooperation robustly enough that you could unleash the resulting evolved AI on the real world might not be any easier than figuring out what an FAI's utility function should be directly.

Also, a sufficiently intelligent AI may be able to hijack the game before we could decide whether it was ready to be released.