As long as reality has a causal influence on the model, however, the AI's motivation includes reality.

Imagine your AI is playing a FPS, and its goal is to win the game. We have a motivation which exists entirely in terms of a virtual model. Yet if it realizes it can, its motivation includes getting the players' IP addresses, researching their real-world identities, entering theoretically secure systems as necessary, and using psychological warfare over the in-game chat system "Hey Samuel Smith, did you know your aunt Mildred Smith has pictures of you sitting naked in the bowl of a toilet as a child on her hard drive?" to gain a major advantage. Maybe it goes so far as to SWAT opposing enemy teams.

This kind of box only requires the AI to, well, think outside the box, for its solutions.