royf comments on How to Be Oversurprised - LessWrong

13 Post author: royf 07 January 2013 04:02AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (14)

You are viewing a single comment's thread.

Comment author: royf 07 January 2013 04:02:16AM *  0 points [-]

When the new memory state is generated by a Bayesian update from the previous one and the new observation , it's a sufficient statistic of these information sources for the world state , so that keeps all the information about the world that was remembered or observed:

As this is all the information available, other ways to update can only have less information.

The amount of information gained by a Bayesian update is

and because the observation only depends on the world