lavalamp comments on Understanding and justifying Solomonoff induction - Less Wrong

1 Post author: gedymin 15 January 2014 01:16AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (75)

You are viewing a single comment's thread. Show more comments above.

Comment author: lavalamp 15 January 2014 06:53:40AM 0 points [-]

The only programs allowed in the Solomonoff distribution are ones that don't have any extended versions that produce the same output observed so far.

Did not know that! It seems like that would leave some probability mass unassigned, how do you rebalance? Even if you succeed, it seems likely that (for large enough outputs) there'll be lots of programs that have epsilon difference--that are basically the same, for all practical purposes.

Comment author: Manfred 15 January 2014 07:31:20AM -1 points [-]

how do you rebalance?

Normalize!

there'll be lots of programs that have epsilon difference--that are basically the same, for all practical purposes.

Solomonoff induction is just defined for binary data. Differences are a minimum of 1 bit,, which is enough.