I agree. This is why I think the Hogwarts letter is charmed to make itself sound more plausible than it should be (which would be a sensible way to ease the transition for muggleborns). Harry explicitly wonders where his own certainty that magic is real comes from and doesn't get an answer via introspection. That sounds like the effect of a weak charm to me.