You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

prase comments on Bayesian exercise - Less Wrong Discussion

5 Post author: RolfAndreassen 21 September 2011 09:34PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (21)

You are viewing a single comment's thread. Show more comments above.

Comment author: prase 22 September 2011 11:39:31AM *  5 points [-]

Right. But rather than to say that you have started with a bad prior (which you effectively did, bud hadn't noticed that you had had such a prior) I would say that the confusion stemmed from bad choice of words. You thought about frequency of failures and said probability of failure, which caused you to think that this is what has to be updated. Frequency of failures isn't a Bayesian probability, it's an objective property of the system. But once you say "probability of failure", it appears that the tested hypothesis is "next launch will fail" rather than "frequency of failures is x". "Next launch will fail" says apparently nothing about this launch, so one intuitively concludes that observing this launch is irrelevant as for that hypothesis, more so if one correctly assumes that failure next time doesn't causally influence chances for failure this time.

Of course this line of thought is wrong: both launches are instances of the same process and by observing one launch one can learn something which applies to all other launches. But it is easy to overlook if one speaks about probabilities of single event outcomes rather than a general model which includes some objective frequencies. So, before you write down the Bayes' formula, make sure what hypothesis you are testing and that you don't mix objective frequencies and subjective probabilities, even if they may be (under some conditions) the same.

(I hope I have described the thought processes correctly. I have experienced the same confusion when I was trying to figure out how Bayesian updating works for the first time.)