PhilGoetz comments on Mathematical simplicity bias and exponential functions - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (82)
There is a formal theory describing how to balance model complexity against fit to data: describe the model using a program on a simple, fixed turing machine, and then penalize that model by assigning a prior probability to it of 2^-L, where L is the length of the program...
this has all been worked out.
Which Turing machine, though?
How about picking one of these?
unpaywalled version