PhilGoetz comments on Rationality Quotes October 2012 - Less Wrong

8 Post author: MBlume 02 October 2012 06:50PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (298)

You are viewing a single comment's thread. Show more comments above.

Comment author: gwern 06 October 2012 12:49:25AM *  15 points [-]

Despite the difficulty of exact Bayesian inference in complex mathematical models, the essence of Bayesian reasoning is frequently used in everyday life. One example has been immortalized in the words of Sherlock Holmes to his friend Dr. Watson: “How often have I said to you that when you have eliminated the impossible, whatever remains, however improbable, must be the truth?” (Arthur Conan Doyle, The Sign of Four, 1890, Ch. 6). This reasoning is actually a consequence of Bayesian belief updating, as expressed in Equation 4.4. Let me re-state it this way: “How often have I said to you that when p(D|θ_i ) = 0 for all i!=j, then, no matter how small the prior p(θ_j ) > 0 is, the posterior p(θ_j |D) must equal one.” Somehow it sounds better the way Holmes said it.

--Kruschke 2010, Doing Bayesian Data Analysis, pg56-57

Comment author: PhilGoetz 01 November 2012 09:07:50PM 5 points [-]

It always irritates me slightly that Holmes says "whatever remains, however improbable, must be the truth", when multiple incompatible hypotheses will remain.

My Holmes says, "When you have eliminated the possible, you must expand your conception of what is possible."