We don't even know Dumbledore was in the castle, as I understand it. Ch88:

A quick glance at the Head Table confirmed that the Divination Professor was waving her wand frantically as the half-Giant dabbed at his clothes. Nobody else seemed to be paying much attention, even Professor McGonagall. Professor Flitwick was standing on his chair as usual, the Headmaster seemed to be absent again (he'd been gone most days of the holiday)

If he's not even at Hogwarts, that seems like it renders it difficult to infer anything from when he shows up since any delay or argument-from-silence could just as well be due to it taking time to phoenix-fire back from whereever and then repoint himself.