Maybe it's to signal that your misdeed was a one-time lapse rather than coming from any deep inner tendency.

For example, if you run over a cat, you might donate money to an animal shelter, which shows that despite what happened you really like animals and would never run one over intentionally.

The financial punishment angle can't hurt, though.