roland comments on How to Measure Anything - LessWrong

50 Post author: lukeprog 07 August 2013 04:05AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (48)

You are viewing a single comment's thread. Show more comments above.

Comment author: roland 30 August 2015 11:19:15AM *  0 points [-]

The technical term for this is conditional entropy.

The conditional entropy will always be lower unless the evidence is independent of your hypothesis(in this case the conditional entropy will be equal to the prior entropy).