Blueberry comments on Open Thread June 2010, Part 4 - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (325)
That check should be part of updating your prior. If you updated and got a hypothesis that didn't fit the data, you didn't update very well. You need to take this into account when you're updating (and you also need to take into account the possibility of experimental error: there's a small chance the data are wrong).
Hopefully the Book Club will get around to covering that as part of Chapter 4.
I can't recall that it has anything to do with "updating your prior"; Jaynes just says that if you get nonsense posterior probabilities, you need to go back and include additional hypotheses in the set you're considering, and this changes the analysis.
See also the quote (I can't be bothered to find it now but I posted it a while ago to a quotes thread) where Jaynes says probability theory doesn't do the job of thinking up hypotheses for you.