True, but the output of the mathematical intuition subroutine is beliefs about mathematical propositions, relationships, structures, and the like, not expectations of future experiences, which is what we seem to value having. So unless you have some point that I'm not getting, your comment doesn't really seem to address my questions.
"Anticipation" refers to feelings associated with the contemplation of future events. All reasonable decision theories contemplate future events - so is it the associated feelings that you are querying? You are suggesting that a "zombie" or "spock" agent might perform just as well? Maybe so - though one might claim that the evaluations of the desirability of the future events such agents contemplate is closely analogous to the "feelings" of more conventionally constructed creatures.
Anticipation and faith are both aspects of the human decision process, in a sense just subroutines of a larger program, but they also generate subjective experiences (qualia) that we value for their own sake. Suppose you ask a religious friend why he doesn’t give up religion, he might say something like “Having faith in God comforts me and I think it is a central part of the human experience. Intellectually I know it’s irrational, but I want to keep my faith anyway. My friends and the government will protect me from making any truly serious mistakes as a result of having too much faith (like falling into dangerous cults or refusing to give medical treatment to my children)."
Personally I've never been religious, so this is just a guess of what someone might say. But these are the kinds of thoughts I have when faced with the prospect of giving up the anticipation of future experiences (after being prompted by Dan Armak). We don't know for sure yet that anticipation is irrational, but it's hard to see how it can be patched up to work in an environment where mind copying and merging are possible, and in the mean time, we have a decision theory (UDT) that seems to work fine, but does not involve any notion of anticipation.
What would you do if true rationality requires giving up something even more fundamental to the human experience than faith? I wonder if anyone is actually willing to take this step, or is this the limit of human rationality, the end of a short journey across the space of possible minds?