gwern comments on Discussion of concrete near-to-middle term trends in AI - Less Wrong

13 Post author: Punoxysm 08 February 2015 10:05PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (48)

You are viewing a single comment's thread. Show more comments above.

Comment author: gwern 11 February 2015 07:26:28PM *  3 points [-]

So by the time this year's competition comes out it should be down to 3%!

I'm not sure ImageNet is of sufficiently high quality that a 3% error rate is meaningful. No point in overfitting noise in the supposed right labels. I think the take-away is that image recognition has gotten really good and now we need a new benchmark/corpus, possibly focused on the special-cases where humans still seem better.