DanielVarga comments on Kevin T. Kelly's Ockham Efficiency Theorem - Less Wrong

30 Post author: Johnicholas 16 August 2010 04:46AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (81)

You are viewing a single comment's thread. Show more comments above.

Comment author: DanielVarga 19 August 2010 06:09:34PM 1 point [-]

We only use boosting if our set of low-complexity hypotheses does not contain the solution we need. And instead of switching to a larger set of still-low-complexity hypotheses, we do something much cheaper, a second best thing: we try to find a good hypothesis in the convex hull of the original hypothesis space.

In short, boosting "outperforms Occam" only in man-hours saved: boosting requires less thinking and less work than properly applying Occam's razor. That really is a good thing, of course.