Having a reputation as a rapist makes it harder for him to survive. [...] tribal societies don't keep many secrets!

On the other hand, in most contemporary and historical agricultural societies, rape is often kept secret, and women have incentives not to make public accusations. This has been true for long enough to allow for some quite drastic changes in behavior to spread through natural selection (on, say, mostly existing variation).