I think this is a great metaphor of what a boxed AI would be able to do to the gatekeeper.
Ironically, it's what a programmer does to AI when stepping through it with a debugger.
I feel like a new term should be coined. "Philosopher's AI", sort of like philosopher's stone or philosophical mercury.
From Toby Ord:
Though there are limits to what AIs could do with sheer speed, it's interesting that great performance can be achieved with speed alone, that this allows different strategies from usual ones, and that it allows the exploitation of otherwise unexploitable glitches and bugs in the setup.