That's a matter of taste, since there is no way to resolve this except on aesthetic grounds.

MWI is not empirically equivalent to all other interpretations of QM. It makes different predictions from the Copenhagen interpretation, for instance. Even if this were not the case, we distinguish between empirically equivalent theories on scientific grounds all the time. Neo-Lorentzian theory is empirically equivalent to the special theory of relativity, but I think (and most scientists agree) that there are good non-empirical grounds for preferring the special theory. You may call these criteria "aesthetic", but that doesn't alter the fact that they are part of the standard explanatory toolbox of physics.

Or else, dispense with interpretations and do physics instead.

Part of doing physics is figuring out the actual structure of our universe, and interpreting QFT is crucial to that task. Physics isn't just about doing calculations.