A problem with the math, not with reality.

There are all kinds of mathematical tricks to deal with infinite quantities. Renormalization is something you'd be familiar with from physics; from my own CS background, I've got asymptotic analysis (which can't see the fine details, but easily can handle large ones). Even something as simple as taking the derivative of your utility function would often be enough to tell which alternative is best.

I've also got a significantly nonzero confidence of infinite negative utility, mind you. Life isn't all roses.