Well, I may have read too much into this statement, that's true. I always assumed that Dumbledore conveniently "going to the Ministry of Magic" on a broomstick or with a Thestral (and not using one of the million other possibilities such as Floo Powder, Portkey, Apparating), then SUDDENLY realizing halfway that Hogwarts is where he ought to be were meant to signify the adult reader that, unlike what Canon!HP understood, Dumbledore knew all along and was trying to trick Voldemort/Quirrel into trying to get the Stone (which was safe inside the mirror of Erised). It also explained the perfect timing of Hagrid and Harry retrieving the Stone from Gringotts the exact same day Quirrel/Voldemort broke in. The Stone had in my opinion been a bait all along, to try and catch the Dark Lord while waiting for the Chosen One to be old enough to defeat him.