PhilGoetz comments on Mathematical simplicity bias and exponential functions - Less Wrong

12 Post author: taw 26 August 2009 06:34PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (82)

You are viewing a single comment's thread. Show more comments above.

Comment author: SforSingularity 29 August 2009 08:58:25PM 0 points [-]

There is a formal theory describing how to balance model complexity against fit to data: describe the model using a program on a simple, fixed turing machine, and then penalize that model by assigning a prior probability to it of 2^-L, where L is the length of the program...

this has all been worked out.

Comment author: Nick_Tarleton 29 August 2009 11:07:12PM 1 point [-]

Which Turing machine, though?

Comment author: SforSingularity 29 August 2009 11:38:14PM 0 points [-]

How about picking one of these?

Comment author: steven0461 29 August 2009 11:56:35PM 2 points [-]