Warrigal comments on Mathematical simplicity bias and exponential functions - Less Wrong

12 Post author: taw 26 August 2009 06:34PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (82)

You are viewing a single comment's thread. Show more comments above.

Comment author: [deleted] 01 September 2010 01:14:58PM 1 point [-]

Occam's razor still applies. If we're looking for the most elegant possible proof of a theorem (whatever that means), any sufficiently short proof is much more likely to be it than any sufficiently long proof. If you want to take a completely wild guess about what statement an unknown theorem proves, you're better off guessing short statements than long ones.

Comment author: cousin_it 01 September 2010 01:39:13PM *  1 point [-]

If we're looking for the most elegant possible proof of a theorem (whatever that means), any sufficiently short proof is much more likely to be it than any sufficiently long proof.

Could you try to make that statement more precise? Because I don't believe it.

If you take the shortest possible proofs to all provable theorems of length less than N, both the maximum and the average length of those proofs will be extremely (uncomputably) fast-growing functions of N. To see that, imagine Gödel-like self-referential theorems that say "I'm not provable in less than 3^^^^3 steps" or somesuch. They're all true (because otherwise the axiom system would prove a false statement), short and easy to formulate, trivially seen to be provable by finite enumeration, but not elegantly provable because they're true.

Another way to reach the same conclusion: if "expected length of shortest proof" were bounded from above by some computable f(N) where N is theorem length in bits, we could write a simple algorithm that determines whether a theorem is provable: check all possible proofs up to length f(N)*2^N. if the search succeeds, say "yes". If the search fails, the shortest proof (if it exists) must be longer than f(N)*2^N, which is impossible because that would make the average greater than f(N). Therefore no shortest proof exists, therefore no proof exists at all, so say "no". But we know that provability cannot be decidable by an algorithm, so f(N) must grow uncomputably fast.

Comment deleted 01 September 2010 01:32:51PM [-]
Comment author: wedrifid 01 September 2010 01:34:50PM 0 points [-]

More emphasis on the most elegant possible.

Comment author: cousin_it 01 September 2010 01:48:34PM *  0 points [-]

Sorry for deleting my comment, I got frustrated and rewrote it. See my other reply to grandparent.

Comment author: wedrifid 01 September 2010 02:27:28PM 0 points [-]

Could you try to make that statement more precise? Because I don't believe it.

I don't believe it either, by the way.