Upvoted. If my wallet is stolen, there has got to be an amazing amount of evidence before the hypothesis 'a time traveler is punishing me for future crimes' would even enter my consciousness. I think that this actually might have an Occam prior low enough that I should start seriously doubting my own sanity before I assign a significant probability to it.

Of course it wouldn't be time travel. People who were especially good at predicting other people's life paths would just do so and punish accordingly, or something.

Edit: I accept your point that future consequences don't suffice to justify time-travelling punishment.

Wasn't there some Twilight Zone episode about this, where a Jewish time traveller used a mind-control device to torment Hitler, which caused his anti-semitism?