I'm assuming you already know this, but in the spirit of stating the obvious: the lower Karma number gives your change over the past 30 days and so if an up-voted post or two falls off of that time window, your number will drop without affecting your recent posts. So anyone who is wondering if they are being karma-assassinated should double-check that they're noticing the right number drop.