Daniel_Burfoot comments on The Objective Bayesian Programme - Less Wrong

13 Post author: cousin_it 06 August 2009 10:33AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (6)

You are viewing a single comment's thread.

Comment author: Daniel_Burfoot 06 August 2009 03:17:43PM 0 points [-]

turns out to be asymptotically least favorable when optimizing the Shannon mutual >information between the parameter and the sample.

Do you mean most favorable? If not, I am very confused.

Comment author: Cyan 06 August 2009 03:27:37PM 1 point [-]

"Least favorable" here is the "min" part of minimax. (The max part is doing the best you can with this least favorable prior.)

Comment author: cousin_it 06 August 2009 03:24:41PM *  1 point [-]

Nope, it's least. :-) The only way to actually unconfuse yourself in this subject is to follow the math carefully. Here's a Google Books link that might help. (The URL is long and weird, does it open on your computer?)

Comment author: Daniel_Burfoot 07 August 2009 02:12:53PM 1 point [-]

URL opens, but it is not especially useful as the odd numbered pages are not displayed by Google books. I suppose it would be a good exercise to try to infer the missing information, but life is short and the way is long.

More useful was the Clarke Barron 1994 paper that states: Jeffrey's prior asymptotically maximizes the Shannon mutual information between a sample of size N and the parameter.

That agrees with my intuition.