Vijay_Krishnan comments on Friedman's "Prediction vs. Explanation" - Less Wrong

7 Post author: Eliezer_Yudkowsky 29 September 2008 06:15AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (79)

Sort By: Old

You are viewing a single comment's thread.

Comment author: Vijay_Krishnan 29 September 2008 09:42:14AM 0 points [-]

I would go with the first one in general. The first one has proved itself on some test data, while all the second one has done is to fit a model on given data. There is always the risk that the second theory has overfitted a model with no worthwhile generalization accuracy. Even if the second theory is simpler than the first the fact that the first theory has been proved right on unseen data makes it a slam dunk winner. Of course further experiments may cause us to update our beliefs, particularly if theory 2 is proving just as accurate.