gwern comments on Amanda Knox Guilty Again - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (61)
Has any government ever investigated the rate of false positives in a jury system by faking trials?
I don't mean real-world corrupt trials, but something like totally fabricating crimes against a hired defendant, and seeing what effect different levels of evidence (or things like race, or the attractiveness of the lawyers) have on the outcome. Ideally, the judge, jury, and lawyers wouldn't know the trial was fake.
Would this be a worthwhile thing to do?
Would the natural experiment of DNA evidence furnish the false positive rate you are interested in?
Yes.
I was concerned about sample bias. However, I found this paper.
They found DNA evidence that was "supportive of exoneration" (versus "inculpative" or "exonerative but insufficient") in 8% of sexual assault convictions (33 in 422) . However, many of the cases provided no determinate evidence, (which means something like too little DNA or no reference DNA). Among cases that provided determinate evidence, 15% (33 in 227) seemed supportive of exoneration.
They present quite a bit of other statistical analysis, but this isn't quite my skill set and I'll need to set aside time to go through it later. I didn't find any other data sources of similar quality, but I looked for <30min. There was a more recent project in Arizona that tried to apply DNA testing more broadly, but that was aimed at doing a cost/benefit for current testing.
Are those two sets of 33 the same 33? If so, then that deserves calling out, because at first reading (at least to me) it sounds like some of the 8% are only "supportive of exoneration" because of a lack of DNA evidence.