I'm assuming that gravity following an inverse square law is just a fact which couldn't be deduced from first principles.

It may actually be derivable anthropically: exponents other than 2 or 1 prohibit stable orbits, and an exponent of 1, as Zack says, implies 2-dimensional space, which might be too simple for observers.