Here's the accompanying article on the paper.

This is a utility function that says "maximize entropy in the environment". The sequence post says, to condense it into an inadequate analogy, "evidence is to thinking as entropy is to thermodynamics".

I'm not asserting this isn't a deep and important finding, but it reminds me of the NES-game playing AI that plays games by taking whatever action maximizes some value in memory over a short time span. Works really well for some games, but it doesn't seem promising as a general NES-game player the same way a human can be (after countless hours of frustrating practice).