Perhaps the six hour limit was placed on time travel a long time ago, by wizards much more powerful than today's, who knew (perhaps first-hand) how nightmarishly screwy time travel could get. This sort of thing has precedent: the Interdict of Merlin prevents the most powerful magical knowledge from being passed on in writing. The reasoning is similar, too: some magic is just that dangerous.