This doesn't quite seem right and here is why; my utility function considers others people's utility function, therefore by acting rationally and maximizing my utility function leaves room for empathy of others.

Yes this is what I said. Usually in game theory setups though, empathy is not included in the utility function. That's what I meant, sorry if it was unclear. You're right that an agent can be rational and empathic at the same time.