Comment on Criticisms of intelligence explosion

Thu, 24 Nov 2011 00:48:44 GMT

By logarithmic do you mean p(x) = exp(-x)? That would only have an entropy of 1, I believe, whereas one can easily obtain unboundedly large amounts of entropy, or even infinite entropy (for instance, p(x) = a exp(-a x) has entropy 1-log(a), so letting a go to zero yields arbitrarily large entropy).

Also, as I've noted before, entropy doesn't make that much sense for continuous distributions.

Discuss