People fail at novel environments as mundane as needing to find a typo in an html file or paying attention to fact-checks during political debates. You don't have to come up with extreme philosophical counterexamples to find domains in which it's interesting to distinguish between the behavior of different non-experts (and such that these differences feel like "intelligence").