Answer this question first: Why aren't compasses magic? They are dead objects that move on their own power to point in the same direction no matter where you take them.

Why isn't gravity magic? It's action at a distance.

Why isn't fire magic? It sure must have seemed like magic a thousand years ago.

Somehow, people knew enough not to call these things magic long before we had any explanation for them. Part of the definition of magic seems to include not existing, or not being demonstrable and repeatable.