That's an interesting notion. I don't see how Bayesian reasoning is restricted to trying to maximize the likelihood of the 'best' theory'. One of its crowning achievements is to avoid talking just about the best theory and using the full ensemble at all times. You're perfectly free to ask any question of the ensemble. This includes 'Which response minimizes some error function?'