Or do you mean in the sense that "utility functions have something to do with expressed and revealed preferences which necessarily correspond to structures in my brain?"

More the latter.

Could they be covered under the umbrella of "I value things which I would enjoy if I tried"?

Yes, but I don't know how to optimize for those things (other than being generally adventurous/curious), since I don't know if I would enjoy them.