khafra comments on Rationality Quotes July 2014 - LessWrong

6 Post author: VAuroch 06 July 2014 06:51AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (195)

You are viewing a single comment's thread. Show more comments above.

Comment author: khafra 10 July 2014 03:31:33PM 3 points [-]

Learning can occur without theory. I spent years researching and developing systems to do just that.

If you're talking about unsupervised classification algorithms, don't they kinda make their theory as they learn? At least, in the "model," or "lossy compression" sense of "theory." Finding features that cluster well in a data set is forming a theory about that data set.

Comment author: Azathoth123 12 July 2014 01:34:32AM 10 points [-]

You still need a theory, a.k.a., a prior on the kind of data you expect to be compressing. Otherwise you run into the No Free Lunch Theorem.