You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

Stuart_Armstrong comments on Summoning the Least Powerful Genie - Less Wrong Discussion

-1 Post author: Houshalter 16 September 2015 05:10AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (48)

You are viewing a single comment's thread.

Comment author: Stuart_Armstrong 16 September 2015 07:29:08PM 2 points [-]

One failure case that bothers me is the AI just shoving a slight modification of it's own source code into the output.

This is the subagent problem again :-(

Comment author: Houshalter 17 September 2015 05:08:44AM 0 points [-]

I feel like designing another AI should be much harder and more complicated in most cases. The only issue is the AI having access to it's own source code. This could potentially be solved. Humans don't have access to our own source code after all.