People punishing norm violations aren't the villains of their own narratives, they think they're responding rationally.

Which does not necessarily mean we should change the way we treat them. They can tell themselves whatever story they like. And by punishing them appropriately they will either change their behavior or, perhaps most importantly, those witnessing the punishment will avoid the behavior that visibly invokes community disapproval.