lessdazed comments on Intuitive Explanation of Solomonoff Induction - Less Wrong

13 Post author: lukeprog 01 December 2011 06:56AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (31)

You are viewing a single comment's thread. Show more comments above.

Comment author: lessdazed 01 December 2011 06:53:19PM 0 points [-]

As it turns out, there is a best recipe for finding truth from uncertainty (although it won't outperform recipes that do things like call for the truth as an ingredient and say not to cook anything). And a recipe that's almost as good for every problem was discovered in the 1960s. It was also discovered that no one could find a better one and know that they had discovered it.

To find a slightly better one and know you had would require you to follow one step after another for an infinite amount of time. That's impossible, so the best you can do in theory is to follow almost as good recipe we have.

The problem is that you don't have time to follow this recipe either. To find the truth to even a simple question using this recipe would require you to follow one step after another until long after the heat death of the universe. While this is less than an infinite amount of time, you can't wait that long either.

Comment author: lukeprog 01 December 2011 07:37:48PM 1 point [-]

I assume some of this, the parts I didn't write, are not meant to be blockquoted?

Comment author: lessdazed 01 December 2011 10:37:44PM 0 points [-]

It was meant as a draft of an alternative, based on my limited understanding. I see two thresholds where I think you see one. The recipe is uncomputable, so it would take longer than "long after the heat death of the universe" or any other finite amount of time to finish. Also, the computable functions most similar to it would take more steps than there is time to do.

Comment author: lukeprog 01 December 2011 10:42:38PM 1 point [-]

Yes, approximations of Solomonoff Induction need to be not just computable but also tractable.

Comment author: lessdazed 03 December 2011 01:06:57AM 0 points [-]

It's a good sign our understandings match, but consider that after simply reading the explanation I thought you meant something other than what you did.