Wei_Dai comments on The Sin of Underconfidence - Less Wrong

55 Post author: Eliezer_Yudkowsky 20 April 2009 06:30AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (176)

You are viewing a single comment's thread. Show more comments above.

Comment author: komponisto 28 September 2012 08:52:59PM 1 point [-]

My "revision" to my Amanda Knox post is one. I was right the first time.

Comment author: Wei_Dai 28 September 2012 09:20:54PM 1 point [-]

How did you end up concluding that your original confidence level was correct after all?

Comment author: komponisto 28 September 2012 10:31:02PM 0 points [-]

I realized that there was a difference between the information I had and the information most commenters had; also that I had underestimated my Bayesian skills relative to the LW average, so that my panicked reaction to what I perceived as harsh criticism in a few of the comments was an overreaction brought about by insecurity.

Comment author: Wei_Dai 01 October 2012 06:43:08AM 1 point [-]

I'm afraid I can't accept your example at this point, because based on my priors and the information I have at hand (the probability of guilt that you gave was 10x lower than the next lowest estimate, it doesn't look like you managed to convince anyone else to adopt your level of confidence during the discussions, absence of other evidence indicating that you have much better Bayesian skills than the LW average), I have to conclude that it's much more likely that you were originally overconfident, and are now again.

Can you either show me that I'm wrong to make this conclusion based on the information I have, or give me some additional evidence to update on?

Comment author: mfb 28 September 2012 10:47:21PM 0 points [-]

Interesting posts.

However, I disagree with your prior by a significant amount. The probability that [person in group] commits a murder within one year is small, but so is the probability that [person in group] is in contact with a victim. I would begin with the event [murder has happened], assign a high probability (like ~90%) to "the murderer knew the victim", and then distribute those 90% among people who knew her (and work with ratios afterwards). I am not familiar enough with the case to do that know, but Amanda would probably get something around 10%, before any evidence or (missing) motive is taken into account.

Comment author: shokwave 29 September 2012 12:19:04AM 0 points [-]

assign a high probability (like ~90%)

A cursory search suggests 54% is more accurate. source, seventh bullet point. Also links to a table that could give better priors.

Comment author: Nornagest 29 September 2012 01:42:44AM *  0 points [-]

I'm reading that as 54% plus some unknown but probably large proportion of the remainder: that includes a large percentage in which the victim's relationship to the perpetrator is unknown, presumably due to lack of evidence. Your link gives this as 43.9%, but that doesn't seem consistent with the table.

If you do look at the table, it says that 1,676 of 13,636 murders were known to be committed by strangers, or about 12%; the unknowns probably don't break down into exactly the same categories (some relationships would be more difficult to establish than others), but I wouldn't expect them to be wildly out of line with the rest of the numbers.

Comment author: mfb 29 September 2012 12:46:24PM *  0 points [-]

I agree with that interpretation. The 13636 murders contain:
*1676 from strangers
*5974 with some relation
*5986 unknown

Based on the known cases only, I get 22% strangers. More than expected, but it might depend on the region, too (US <--> Europe). Based on that table, we can do even better: We can exclude reasons which are known to be unrelated to the specific case, and persons/relations which are known to be innocent (or non-existent). A bit tricky, as the table is "relation murderer -> victim" and not the other direction, but it should be possible.