So although Model 2 may make up most of the probability mass, it contributes nothing important to the expected value computation determining A's actions.

Given this fact, I couldn't follow the discussion of A's tendency to believe Model 2 in "approximate AIXI" section. Model 2 doesn't have any effect, so why worry about its probability? What matters is relative probability of models that do depend on their arguments.