If I'm accustomed to people arguing for theism from authority (e.g., "I know God wants me to perform these rituals in this way, because my priest said so"), impugning the credibility of the authority figure (e.g., "Oh yeah? Well, your priest molests children!") is an understandable response.

But you're right, of course, that it isn't itself evidence for or against much of anything.