Hm. If we were using physics here, I'd observe that a usable time turner has to be tied into things like the rotation and movement of the earth, because traveling back in time without taking those things into account somehow leaves one stranded in interplanetary or interstellar space. Given that we're talking magic, well, who knows. But sure, I agree that it's suggestive but inconclusive.