rstarkov comments on Bayesianism in the face of unknowns - Less Wrong

1 Post author: rstarkov 12 March 2011 08:54PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (35)

You are viewing a single comment's thread. Show more comments above.

Comment author: rstarkov 12 March 2011 11:10:15PM 0 points [-]

Preferably, let other people play the game first to gather the evidence at no cost to myself.

For the record, this is not permitted.

My take at it is basically this: average over all possible distributions

It's easy to say this but I don't think this works when you start doing the maths to get actual numbers out. Additionally, if you really take ALL possible distributions then you're already in trouble, because some of them are pretty weird - e.g. the Cauchy distribution doesn't have a mean or a variance.

distribution about which we initially don’t know anything and gradually build up evidence

I'd love to know if there are established formal approaches to this. The only parts of statistics that I'm familiar with assume known distributions and work from there. Anyone?

Comment author: saturn 13 March 2011 03:37:26AM 1 point [-]

If I'm not mistaken, the Cauchy distribution wouldn't be included because it's not supported on a bounded interval.

Comment author: Perplexed 13 March 2011 04:09:13AM 0 points [-]

I'd love to know if there are established formal approaches to this.

You should probably look at Jaynes's book "Probability Theory: the Language of Science". In particular, I think that the discussion there dealing with the Widget Problem and with Laplace's Rule of Succession may be relevant to your question.

Comment author: rstarkov 13 March 2011 03:26:03PM 0 points [-]

And just as it gets really interesting, that chapter ends. There is no solution provided for stage 4 :/

Comment author: Perplexed 13 March 2011 05:23:13PM 0 points [-]

Odd. The printed book has another page and a half for that chapter, including the solution to Stage 4. (No surprises in the solution - same as stage 3 except you start with 40 fewer Green widgets.)