In the above examples, there may well be more net harm than gain from staying in an unpleasant relationship or firing a problematic employee. It's pretty case-by-case in nature, and you're not required to ignore your own feelings entirely. If not, yes, utilitarianism would say you'd be "wrong" for indulging yourself at the expense of others.