Will_Newsome comments on Secrets of the eliminati - Less Wrong

93 Post author: Yvain 20 July 2011 10:15AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (252)

You are viewing a single comment's thread. Show more comments above.

Comment author: Will_Newsome 23 July 2011 10:32:10PM 1 point [-]

One of my 30 or so Friendliness-themed thought experiments is called "Implicit goals of ArgMax" or something like that. In general I think this style of reasoning is very important for accurately thinking about universal AI drives. Specifically it is important to analyze highly precise AI architectures like Goedel machines where there's little wiggle room for a deus ex machina.