Semi-legitimate might be a better descriptor. If someone destroyed me or the ones I loved out of spite and took pleasure in it, I would probably hate them and probably feel that my hate was legitimate. If I went through any traumatic experience like torture or rape, I would probably come out of that with some hate.

I'm an egoist, not a utilitarian (I have strong utilitarian preferences though). That probably has implications for this as well.