Stuart_Armstrong comments on The subagent problem is really hard - Less Wrong Discussion
You are viewing a comment permalink. View the original post to see all comments and the full post content.
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (9)
Why would they be non-superintelligent? And why would they need a controller? If the AI is under some sort of restriction, the most effective idea for it would be to create a superintelligent being with the same motives as itself, but without restrictions.
Well, banning the creation of other superintelligence seems easier than banning the creation of any subagents.
How? (and are you talking in terms of motivational restrictions, which I don't see at all, or physical restrictions, which seem more probable)