Any utility function has to be calculated sensory inputs and internal state - since that's all the information any agent ever has. Any extrapolation of an external world is calculated in turn from sensory inputs and internal state. Either way, the domain of any utility function is ultimately sensory inputs and internal state. There's not really a 'problem' with working from sensory inputs and internal state - that's what all agents necessarily have to do.