I understand the argument Gowers is making, and believed it until recently. The disagreement boils down to a factual claim about the world, which is going to have to be resolved by actually looking out at the world.
For concreteness, here is how I would suggest trying to bring in information from the territory. Find some development which has been important in human history, and then working backwards argue that broader and broader theoretical contributions were valuable insofar as they facilitated this development. If any of these theoretical contributions were needed before there was evidence of their importance, then this provides some evidence that working on apparently useless problems is valuable.
If no examples of this form can be produced (I concede that the actual steps in such an argument might be difficult to verify, but I have seen very few plausible candidates), then it seems to offer compelling evidence that belief in the usefulness of interesting problems is, minimally, unfounded.
I should also say that my standards for usefulness may be lower than some mainstream critics of science (although they still reject a great deal of modern mathematics). For example, I would contend that trying to understand any physical phenomena which occur at low energies is obviously useful, and that understanding any completely mysterious phenomena at any energy is plausibly useful.
Find some development which has been important in human history, and then working backwards argue that broader and broader theoretical contributions were valuable insofar as they facilitated this development.
Your previous comments indicate that you have a ready-made formula for rejecting any such example, which is to deny that the theoretical contributions were "necessary". That is, you will argue that the important development "could have" happened without them. For instance, you addressed the classic example of non-Euclidean geomet...
For the past few days I've been pondering the question of how best to respond to paulfchristiano's recent posts and comments questioning the value of mathematical research. I don't think I can do it concisely, in a single post; bridging the inferential distance may require something more like a sequence of posts. I may end up writing such a sequence eventually, since it would involve ideas I've actually been wanting to write up for some time, and which are actually relevant to more than just the specific questions at issue here (whether society should sponsor mathematics, and given that it does, whether paulfchristiano or anyone else in the LW readership should pursue it).
However, as the preceding parenthetical hints at, I'm actually somewhat conflicted about whether I should even bother. Although I believe that mathematical research should be conducted by somebody, it's not at all clear to me that the discipline needs more people beyond those who already "get" its importance, and are out there doing it rather than writing skeptical posts like paulfchristiano's. It seems perfectly plausible to me that those who feel as paulfchristiano does should just leave the profession and do something else that feels more "important" to them. This is surely the best practical solution on an individual level for those who think they have a better idea than existing institutions of where the most promising research directions lie, at least until Hansonian prediction markets are (ever) implemented.
Nevertheless, for those interested in the society-level question of whether mathematics (as such) may be justifiably pursued by anyone, or any community of people, as a professional occupation (which is quite distinct from the question of whether e.g. paulfchristiano should personally pursue it), I recommend, at least as a start, grappling with the arguments put forward by the best mathematicians in their own words. I think this essay by Timothy Gowers (a Fields Medalist), titled "The Importance of Mathematics", is a good place to begin. I would particularly draw the attention of those like paulfchristiano, who think they have a good idea of which branches of mathematics are useful and which aren't, to the following passage, from pp.8-9 (unfortunately the illustrations are missing, but the point being made is pretty clear nonetheless):