Tyrrell_McAllister comments on What Bayesianism taught me - LessWrong

62 Post author: Tyrrell_McAllister 12 August 2013 06:59AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (201)

You are viewing a single comment's thread. Show more comments above.

Comment author: Tyrrell_McAllister 13 August 2013 10:30:22PM 1 point [-]

Does this give one any reason to believe that, if two hypotheses are under consideration, the simpler one is a priori more likely? If not, it seems to me to be missing something too crucial to be called a formalization of Occam's razor.

Comment author: ciphergoth 14 August 2013 07:01:08AM *  0 points [-]

Right, you'd need more than that one axiom before you could really say you had a formulation of Occam's Razor. I'm just making a more specific point, that whatever formulation of complexity you come up with, so long as it satisfies the axiom above, will have the property that any probability distribution over discrete outcomes must assign diminishing probability to increasingly complex hypotheses in the limit.

EDIT: actually even without that axiom, so long as you consider only discrete hypotheses and your definition of complexity maps hypotheses to a real positive number representing complexity, you will have that the mass of probability given to hypotheses more complex than x falls to zero as x goes to infinity.