You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

Coscott comments on Maximize Worst Case Bayes Score - Less Wrong Discussion

7 Post author: Coscott 17 June 2014 09:12AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (22)

You are viewing a single comment's thread. Show more comments above.

Comment author: Coscott 20 June 2014 07:37:39PM 0 points [-]

I actually thought of exactly this construction at our last MIRIx on Saturday. It made me sad. However here is a question I couldn't answer. Can you do the same thing with a coherent P? That I do not know.

If Bayes is continuous in M for coherent P then we would be able to prove the first conjecture.

Something slightly easier, maybe we can show that if Bayes is not continuous at the point M for coherent P, then P must assign nonzero probability to M. I am also not sure if this would prove the conjecture, but haven't really thought about this angle yet.

Another interesting thing to think about: What happens if we start with the P you described and then do the algorithm in the second conjecture.

I haven't told you everything about this algorithm yet. One frustrating thing is that if you want to change a probability from p to q in one step, you can write down how much your bayes score increases. Since bayes score is bounded above, you can only do this finitely many times. However, if you update a probability from p to q in a series of very small steps, you could in theory only increase your bayes score by an arbitrarily small amount. :(

I just recently started trying to prove the first conjecture without the second conjecture, so I have more hope that there is something easy there I just missed.

I think you know most of what I know about the first conjecture. Abram gave me a sketch of a proof that if P is the WCB maximizer then WCB(P) is Exp(Bayes(M,P)) (when M is chosen according to P), but we haven't really checked it. If you (or someone else who would like to try to find this proof) would like to know more about the second conjecture, you can pm me your email, I will send you my personal notes, and we can set up a skype chat?

The second conjecture implies the first, and If that is true, I would really like to know, because I think it makes the result much nicer.