To call "don't downvote if I'm in the conversation" a local norm might be overstating the case. I've heard several people assert this about their own behavior, and there are good reasons for it (and equally good reasons for not upvoting if I'm in the conversation), but my own position is more "distrust the impulse to vote on something I'm emotionally engaged with."