Tool-AIs do not contain such a component - they might have a relevance or accuracy function for evaluating answers, but it's not a utility function over the world.

Wouldn't that depend on the Tool-AI?

I think this is explicitly part of the "Tool-AI" definition, that it is not a Utility Maximizer.