OrphanWilde comments on AI, cure this fake person's fake cancer! - Less Wrong Discussion
You are viewing a comment permalink. View the original post to see all comments and the full post content.
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (18)
No, it can do anything that its worldview includes, and any operations defined internally. You're no longer talking about a Godel Machine, and you've lost all your safety constraints.
You can give, in theory of course, a formal description of the laws of physics. Then you can ask it to produce a plan or machine which fulfills any constraints you ask. You don't need to worry about it escaping from the box. Now it's solution might be terrible without tons of constraints, but it's at least not optimized to escape from the box or to trick you.