= 27d567bc2d48d9f40e9ccc20ea370b15)
ChristianKl comments on ClearerThinking's Fact-Checking 2.0 - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
= 783df68a0f980790206b9ea87794c5b6)
Loading…= b715d02e85f7b3b4ae65ca3d3e450868)
Subscribe to RSS Feed
Powered by Reddit
= f037147d6e6c911a85753b9abdedda8d)
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (40)
I'm still fairly skeptical that algorithmically fact-checking anything complex is tractable today. The Google article states that "this is 100 percent theoretical: It’s a research paper, not a product announcement or anything equally exciting." Also, no real insights into nlp are presented; the article only suggests that an algorithm could fact check relatively simple statements that have clear truth values by checking a large database of information. So if the database has nothing to say about the statement, the algorithm is useless. In particular, such an approach would be unable to fact-check the Fiorina quote you used as an example.
Do you think fact checking is an inherently more difficult problem then what Watson can do?
It depends what level of fact checking is needed. Watson is well-suited for answering questions like "What year was Obama born?", because the answer is unambiguous and also fairly likely to be found in a database. I would be very surprised if Watson could fact check a statement like "Putin has absolutely no respect for President Obama", because the context needed to evaluate such a statement is not so easy to search for and interpret.
I'm not sure that a statement like that has to tagged as a falsehood. I would be fine with a fact checker that focuses on statements that are more clearly false.
Yes, because Watson's corpus doesn't contain people lying. On the other hand, for political fact-checking the corpus is going to have tons of lies, half-truth, and BS.
I think the standard for accuracy would be very different. If Watson gets something right you think "Wow that was so clever", if it's wrong you're fairly forgiving. On that other hand, I feel like if an automated fact checker got even 1/10 things wrong it would be subject to insatiable rage for doing so. I think specifically correcting others is the situation in which people would have the highest standard for accuracy.
And that's before you get into the levels of subjectivity and technicality in the subject matter which something like Watson would never be subjected to.
Given that Watson get's used to make medical decisions about how to cure cancer I don't think people are strongly forgiving.