= 27d567bc2d48d9f40e9ccc20ea370b15)
matt comments on Rationality Quotes December 2011 - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
= 783df68a0f980790206b9ea87794c5b6)
Loading…= b715d02e85f7b3b4ae65ca3d3e450868)
Subscribe to RSS Feed
Powered by Reddit
= f037147d6e6c911a85753b9abdedda8d)
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (577)
In the absence of observations of future events, observation of the past performance of your model is advisable (and rare). If your confidence in the current accuracy of your model is much higher than the past performance of your models... you may be optimizing for something other than accuracy.
Agreed, and in particular on data you did not consider in formulating it.
Citation needed.
Your criticism is accepted. For my curiosity: which groups have you observed embracing the practice of introducing data on past model performance when presenting a new model? I failed to provide a source, but is it your impression that this isn't an area in which most people perform poorly
I don't know that I've observed anyone making explicit practice of it out of a formal setting.