= 27d567bc2d48d9f40e9ccc20ea370b15)
shokwave comments on Statistical Prediction Rules Out-Perform Expert Human Judgments - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
= 783df68a0f980790206b9ea87794c5b6)
Loading…= b715d02e85f7b3b4ae65ca3d3e450868)
Subscribe to RSS Feed
Powered by Reddit
= f037147d6e6c911a85753b9abdedda8d)
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (195)
Irrelevant is excessive. When you say 'system A works better than system B' this implies that system A should be used and this is clear cut. But the notion 'works better' lacks a rigorous definition. Is the machine better if it wins 90% of the time by 5%, and fails the other 10% by 40%? It's not as simple as saying .9 * .05 > .1 * .4. The cost of error isn't necessarily linear.
Now why these systems aren't used in ensembles with humans is indeed a great question. I can imagine that in most cases we could also ask 'why don't we double the number of experts who are collaborating on a given problem?' under the presumption that more minds would likely result in a better performance across the board. I wouldn't be surprised if there was a lot of overlap in the answers. Coordination difficulty is likely high up there. Thus,
possibly becomes the explanation.
Keep in mind this is in the conclusion of lukeprog's post:
Now,
If the cost of error isn't linear, determine what function it follows, then use that function instead of a linear function to compare the relative costs, which will tell you which works better.
I stand by it. The post is saying, given that SPRs work, work better than experts, and don't fail where experts don't, we should use them instead of experts. Your points were that SPRs don't always work, tend not to work in border cases, and might fail in dangerous cases. The first point is only true in cases this post is not concerned with, the second is equally true of experts and SPRs, and the third is also equally true of experts and SPRs.