Wei_Dai comments on Drawing Two Aces - Less Wrong

14 Post author: Eliezer_Yudkowsky 03 January 2010 10:33AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (84)

You are viewing a single comment's thread. Show more comments above.

Comment author: Wei_Dai 03 January 2010 11:38:01PM 11 points [-]

If the problem is too easy, consider the meta-problem: what makes argument 1 seductive, and how can we teach ourselves to easily see through such arguments in the future?

(In this case it was easy to see the flaw in argument 1 because argument 2 was laid out right beside it. What if all we had was argument 1?)

I think perhaps our intuitive understanding of "state of knowledge" is wrong, and we need to fix it, but I'm not sure how.

Comment author: Morendil 04 January 2010 07:10:52AM *  0 points [-]

In this particular case, all we need to do is encode our "state of knowledge" formally into the relevant probabilities, mooting all appeals to intuition.

However this is a "toy problem", in real-world situations I expect that it will not be practical to enumerate all possible outcomes.

I am helping a colleague of mine investigate application of Bayesian inference methods to the question of software testing, and we're seeing much the same difficulty: on an extremely simplified problem we can draw definite conclusions, but we don't yet know how to extend those conclusions to situations the industry would consider relevant.