passive_fist comments on [LINK] The Bayesian Second Law of Thermodynamics - Less Wrong Discussion
You are viewing a comment permalink. View the original post to see all comments and the full post content.
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (16)
'order' is not a well-defined concept. One person's order is another's chaos. Entropy, on the other hand, is a well-defined concept.
Even though entropy depends on the information you have about the system, the way that it depends on that is not subjective, and any two observers with the same amount of information about the system must come up with the exact same quantity for entropy.
All of this might seem counter-intuitive at first but it makes sense when you realize that Entropy(system) isn't well-defined, but Entropy(system, model) is precisely defined. The 'model' is what Bayesians would call the prior. It is always there, either implicitly or explicitly.