jimrandomh comments on Dreams of AIXI - Less Wrong

-1 Post author: jacob_cannell 30 August 2010 10:15PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (145)

You are viewing a single comment's thread. Show more comments above.

Comment author: jimrandomh 31 August 2010 06:24:56AM 4 points [-]

There is an enormous difference between the formal mathematical definition of "computable", and "able to be run by a computer that could be constructed in this universe". AIXI is computable in the mathematical sense of being written as a computer program that will provably halt in finitely many steps, but it is not computable in the sense of it being possible to run it, even by using all the resources in the observable universe optimally, because the runtime complexity of AIXI is astronomically larger than the universe is.

Comment author: wedrifid 31 August 2010 11:19:53AM 13 points [-]

because the runtime complexity of AIXI is astronomically larger than the universe is.

'Astronomically'? That's the first time I've seen that superlative inadequate for the job.

Comment author: Vladimir_Nesov 31 August 2010 09:44:20AM *  5 points [-]

AIXI is computable in the mathematical sense of being written as a computer program that will provably halt in finitely many steps

AIXI's decision procedure is not computable (but AIXItl's is). (Link)

Comment author: jacob_cannell 31 August 2010 06:45:53AM 0 points [-]

Yes, I think the term in computational complexity theory is tractability, which is the practical subset of computability.

AIXI is interesting just from a philosophical perspective, but even in the practical sense it has utility in showing what the ultimate limit is, and starting there you can find approximations and optimizations that move you into the land of the tractable.

For an example analogy, in computer graphics we have full blown particle ray tracing as the most accurate theory at the limits, and starting with that and then speeding it up with approximations that minimize the loss of accuracy is a good strategy.

The monte carlo approximation to AI is tractable and it can play small games (fairly well?).

For a more practical AGI design on a limited budget, its probably best to use hierarchical approximate simulation, more along the lines of what the mammalian cortex appears to do.