The linked Wikipedia page provides a succinct derivation from Shannon and Bayes' Theorem.
Heh. I think you're trying to generalize a narrow result way too much. Especially when we are not talking about compression ratios, but things like "explanatory power" which is quite different from getting to the shortest bit string.
Let's take a real example which was discussed on the LW recently: the heliocentrism debates in Renaissance Europe, for example between Copernicus and Kepler, pre-Galileo (see e.g. here). Show me how the MML theory is relevant to this choice between two competing theories.
Sean Carroll, physicist and proponent of Everettian Quantum Mechanics, has just posted a new article going over some of the common objections to EQM and why they are false. Of particular interest to us as rationalists:
Very reminiscent of the quantum physics sequence here! I find that this distinction between number of entities and number of postulates is something that I need to remind people of all the time.
META: This is my first post; if I have done anything wrong, or could have done something better, please tell me!