Do you want to become stronger in the way of Bayes? This post is intended for people whose understanding of Bayesian probability theory is currently somewhat tentative (between levels 0 and 1 to use a previous post's terms), and who are interested in developing deeper knowledge through deliberate practice.
Our intention is to form an online self-study group composed of peers, working with the assistance of a facilitator - but not necessarily of a teacher or of an expert in the topic. Some students may be somewhat more advanced along the path, and able to offer assistance to others.
Our first text will be E.T. Jaynes' Probability Theory: The Logic of Science, which can be found in PDF form (in a slightly less polished version than the book edition) here or here.
We will work through the text in sections, at a pace allowing thorough understanding: expect one new section every week, maybe every other week. A brief summary of the currently discussed section will be published as an update to this post, and simultaneously a comment will open the discussion with a few questions, or the statement of an exercise. Please use ROT13 whenever appropriate in your replies.
A first comment below collects intentions to participate. Please reply to this comment only if you are genuinely interested in gaining a better understanding of Bayesian probability and willing to commit to spend a few hours per week reading through the section assigned or doing the exercises.
As a warm-up, participants are encouraged to start in on the book:
Preface
Most of the Preface can be safely skipped. It names the giants on whose shoulders Jaynes stood ("History", "Foundations"), deals briefly with the frequentist vs Bayesian controversy ("Comparisons"), discusses his "Style of Presentation" (and incidentally his distrust of infinite sets), and contains the usual acknowledgements.
One section, "What is 'safe'?", stands out as making several strong points about the use of probability theory. Sample: "new data that we insist on analyzing in terms of old ideas (that is, models which are not questioned) cannot lead us out of the old ideas". (The emphasis is Jaynes'. This has an almost Kuhnian flavor.)
Discussion on the Preface starts with this comment.
I think one should learn on different levels at the same time:
If you only do what's convenient, your progress stops.
If you don't revisit the basics from time to time, you build on sand.
It is necessary to challenge oneself and at the same time work on the fundamentals. It is both inspiring and necessary to strike the right balance between the two extremes: A constant back and forth between them proved to be both the most productive and most entertaining for me personally.
This is the reason I am also interested in this study group: For me, it is revisiting the fundamentals. Although this book is relatively basic, it is very well written and focuses more on the right philosophy than the actual pragmatic issues. On the other hand, it is very detailed at places that other books easily take for granted and points out issues that other just step over. It is really a great reading to deepen one's knowledge. I am unsure though, whether it is the best introductory reading for someone who just wants to acquire a practical skill set.
This should be engraved somewhere in big letters.