Yeah, that's plausible in my case as well. Evidence in favor of it is that I do become mildly anxious when people who are responding to me get downvoted by others, which suggests that I fear retaliation.