taw comments on A History of Bayes' Theorem - Less Wrong

53 Post author: lukeprog 29 August 2011 07:04AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (85)

You are viewing a single comment's thread. Show more comments above.

Comment author: taw 30 August 2011 12:11:10PM 4 points [-]

For sample size, it's actually objectively measurable. For recency etc. you can just use your expert judgment and validate against data with ad hoc techniques.

Ask Nate Silver for details if you wish. He never indicated he has a big Bayesian model behind all that.

You reach a point very early where model uncertainty makes Bayesian methods no better than ad hoc methods.

Comment author: magfrump 01 September 2011 08:22:44AM 1 point [-]

I don't mean to argue that Nate Silver had a "big Bayesian model behind all that." But if sample size and recency increase the reliability of polls, you can objectively measure how much they do and it seems that using Bayesian methods you could create an objectively best prior weighting system, which seems like the point that Vaniver was making.

I'm not immediately familiar with the math but it seems odd to me that it would be much more work to do a regression for a "best prior" than to come up with an ad hoc method, especially considering that "expert judgment" tends to be really bad (at least according to Bishop and Trout ).

Of course, I should probably wait to disagree until he [Nate Silver] gets something wrong.