jsteinhardt comments on Interesting talk on Bayesians and frequentists - Less Wrong

7 Post author: jsteinhardt 23 October 2010 04:10AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (18)

You are viewing a single comment's thread. Show more comments above.

Comment author: jsteinhardt 01 September 2011 12:53:02PM 1 point [-]

the frequentist method says to use success/total

This is false (as explained in the linked-to video). If nothing else, the frequentist answer depends on the loss function (as does the Bayesian answer, although the posterior distribution is a way of summarising the answer simultaneously for all loss functions).

I think you're taking the frequentist interpretation of what a probability is and trying to forcibly extend it to the entire frequentist decision theory. As far as the "frequentist interpretation of probability" goes, I have never met a single statistician who even explicitly identified "probabilities as frequencies" as a possible belief to hold, much less claimed to hold it themselves. As far as I can tell, this whole "probabilities as frequencies" thing is unique to LessWrong.

Everyone I've ever met who identified as a frequentist meant "not strictly Bayesian". Whenever a method was identified as frequentist, it either meant "not strictly Bayesian" or else that it was adopting the decision theory described in Michael Jordan's lecture.

In fact, the frequentist approach (not as you've defined it, but as the term is actually used by statisticians) is used precisely because it works extremely well in certain circumstances (for instance, cross-validation). This is, I believe, what Mike is arguing for when he says that a mix of Bayesian and frequentist techniques is necessary.