You're right! I've been so caught up (for years now) with explaining to people that mathematics was not a science because it was not empirical (although, as I've since learned from Eliezer, "pure thought" is still a physical process that we must observe in order to learn anything from it), that I've totally failed to actually think about the issue.

There goes another cached thought from my brain; good riddance, and thanks for the correction!