If you don't know about relative motion and inertia, then it does seem like the sun moves around the earth (even when you know, it still looks that way). Prior to the "Copernican" revolution, it was generally thought that our sense experience of everyday life was sufficient to expose the truth to us. Those two things combined make a major roadblock in establishing that the earth rotates.

Now we can fully appreciate that it doesn't even make sense to make an absolute statement either way. If earth is taken to be stationary, then the sun does move around it (interestingly, this was Tycho Brahe's solution to the problem of shifting to a helio-centric view.)

There's a better version of this discussion - Anscombe's reply, for example, is worth quoting: http://lesswrong.com/lw/2p1/a_failure_to_evaluate_returnontime_fallacy/2l29?c=1