And, wait for it...
(no, seriously, wait 5 seconds for it)
the laws of physics did turn out to be particularly simple. In the 5 seconds you were waiting, did the air wafting around the room obey Navier-Stokes, or Navier-Stokes+a-dragon-randomly-appears? Both of those are fine, formalizable mathematical rules; one just happens to be much much simpler than the other.
And because the observed laws of physics are so particularly simple, they are dwarfed in number by mathematically possible more complex laws that we never observe. Choose between "Navier-Stokes" and "Navier-Stokes+dragon-after-half-a-second" and "Navier-Stokes+dragon-after-a-quarter-second" and so on; why do you expect to see the former rule rather than any of the infinite collection of latter rules? Without some kind of special privileged probability measure, we have no reason to expect to be in such a special universe, but here we are.
Laws of physics are not some deep mysterious algorithms built into the universe when it was created, they are human approximations of the infinite complexity we observe. As long as the universe is at least somewhat predictable and not completely random, it is possible to construct a series of increasingly accurate ways to predict its behavior. If the universe included predictable dragons after half a second, these approximations would, too. In fact, the Navier Stokes equations happen to describe so many dragons, there is still an open Millennium problem re...
Another month has passed and here is a new rationality quotes thread. The usual rules are: