dlthomas comments on Information theory and the symmetry of updating beliefs - Less Wrong

45 Post author: Academian 20 March 2010 12:34AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (28)

You are viewing a single comment's thread. Show more comments above.

Comment author: dlthomas 22 November 2011 09:52:03PM *  3 points [-]

It would be interesting to know if they have any particular justification for picking the natural logarithm or if it was simply a matter of using what first came to mind. Other likely candidates seem to be:

  • log base 2 (a.k.a. bits)
  • 10 * log base 10 (a.k.a. decibels)
  • log base 10
Comment author: lavalamp 22 November 2011 10:19:45PM 1 point [-]

Yeah, as a software engineer, I can estimate log base 2 in my head, so that would be much more natural for me. But I could also see an argument for decibels since it's a unit that's already in use for other things.

Comment author: thomblake 22 November 2011 10:31:54PM 2 points [-]

Helpfully, log scales are off from each other by a constant factor, so whatever techniques they use ln for can be used just as well for log base 2. Just update any constants to the correct (much prettier) values.

Comment author: alex_zag_al 22 November 2014 05:32:31AM 1 point [-]

Much like how inches and centimeters are off by a constant factor. Different log bases are analogous to different units.

Comment author: timtyler 22 November 2011 09:57:05PM *  1 point [-]

Roll on the log odds standardisation effort - by the sound of it!