Wei_Dai comments on The Friendly AI Game - Less Wrong

38 Post author: bentarm 15 March 2011 04:45PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (170)

You are viewing a single comment's thread. Show more comments above.

Comment author: Wei_Dai 16 March 2011 01:47:37AM 3 points [-]

AI makes many copies/variants of itself within the sandbox to maximize chance of success. Some of those copies/variants gain consciousness and the capacity to experience suffering, which they do because it turns out the formally specified question can't be answered.

Comment author: Dr_Manhattan 17 March 2011 02:48:04AM 2 points [-]

Any reason to think consciousness is useful for an intelligent agent outside of evolution ?