You can give, in theory of course, a formal description of the laws of physics. Then you can ask it to produce a plan or machine which fulfills any constraints you ask. You don't need to worry about it escaping from the box. Now it's solution might be terrible without tons of constraints, but it's at least not optimized to escape from the box or to trick you.