The situation with a fairly accurate human psychologist is drastically different.

I'm not sure if there is a way of easily pinpointing the problem with your reasoning, but the TDT paper is probably thorough enough to resolve it. See also Manfred's comment: if the psychologist is "one level higher than you", your reasoning could already be taken into account, and depending on how you reason, you could receive different reward.