cousin_it comments on Understanding and justifying Solomonoff induction - Less Wrong

1 Post author: gedymin 15 January 2014 01:16AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Article Navigation

Comments (75)

Comments (75)

You are viewing a single comment's thread. Show more comments above.

Comment author: cousin_it 15 January 2014 05:51:08PM 4 points [-]

It's a well known argument, I learned it from Shalizi's note. There's other work trying to justify Occam's razor when the set of hypotheses is finite, e.g. Kevin Kelly's work.

Comment author: MrMind 15 January 2014 06:27:04PM *  0 points [-]

Thanks for the very interesting papers.

In Kelly's page, this

Bayesian explanations of Ockham’s razor are based on a circular appeal to a prior bias toward simple possibilities.

I think it is possible to appeal to simpler principles, modifying some of the points I made above.

Indeed, I think it is possible to non-circularly explain why

the Razor is the rule which says "among the theories compatible with the evidence, chose the simplest", and the question is why this leads to the truth better than a rule like "among the theories compatible with the evidence, chose the one whose statement involves the fewest occurrences of the letter 'e'", or even "the one which most glorifies Divine Providence".

Powered by Reddit Powered by Reddit