Perfect information? As far as I know all tricks used in most TAS videos were discovered by players, most of the time by accident. Kinda like how scientists discover(ed) the laws of physics.
The point is that these speed runs presumably involve backtracking. They can rewind time and explore different paths until they find one they like.
From Toby Ord:
Though there are limits to what AIs could do with sheer speed, it's interesting that great performance can be achieved with speed alone, that this allows different strategies from usual ones, and that it allows the exploitation of otherwise unexploitable glitches and bugs in the setup.