I read this essay while I was still working in pure mathematics. I'm not sure whether I agreed with it then (I think I saw it more as a cheer for the home team than something that I analyzed critically). Skimming through it now, I am very skeptical of his main claim, which is that math is so interconnected that the very applied end of math benefits from the very pure end of math. His argument breaks down for at least four reasons:
(1) He gives examples of problem P1 in field F1 being related to problem P2 in field F2, then of problem P2' in field F2 being related to problem P3 in field F3, and concludes therefore that F1 and F3 are related. There is no reason why this should be true.
(2) Just because two problems P1 and P2 are distantly related to each other doesn't mean that the most efficient use of resources for solving problem P2 is to work on problem P1. The obvious counterargument is that the point is not to solve a specific problem, but to advance the field of mathematics as a whole. But one always has the choice to work on problems that are more or less centrally related to mathematics as a whole, and to the parts of mathematics that have any chance of actually being applied.
(3) Gowers' main example of a pure math problem tying in to applied mathematics is the relationship between partial differential equations and various problems in discrete mathematics. However the typical application here is that partial differential equations are used as a solution method to the discrete problem --- we turn the discrete problem into its continuous analog, which is much better understood, and then bound the difference between the continuous analog and the original discrete problem. Thus in his example it is actually partial differential equations, with their much more developed theory, being used to better understand the pure mathematical object; the theory of PDEs is not getting pushed forward at all.
(4) Gowers also gives the example of the relevance of the Kakeya problem to harmonic analysis, which I agree is actually a useful result. However, the conclusion to draw from this anecdote is that a randomly chosen problem has some non-zero probability of being relevant to at least one "practical" problem. We should expect to get "lucky" like this just as well if we focus on applications.
(Edited: removed reason (5) due to insufficient justification.)
From my above comments, you have probably gathered that I have moved to more applied fields than pure math. I did this for two reasons:
(1) To be able to make any claim about the practical value of math, one needs to have an understanding of how math is actually used.
(2) I realized that without any external measures of progress, the standards for whether a problem is worthwhile come down to essentially a weighted vote.
Reason (2) is tenuous but I think clear in some fields. However, I think reason (1) is a pretty solid reason that even the purest mathematicians should have some dialogue with applied researchers (or have done applied research themselves at some point).
...This requires more justification than I am currently giving it, but it is easy to find examples of math problems that don't have even a tenuous connection to reality (I have also noticed that some pure mathematicians nevertheless argue that it does; their arguments are so weak that I can only conclude that they are trying to retroactively justify a decision they already made, and I am saying this as someone who has published papers in the field in question). The source of examples I am most familiar with is (a large portion of) enumerative combinatorics.
For the past few days I've been pondering the question of how best to respond to paulfchristiano's recent posts and comments questioning the value of mathematical research. I don't think I can do it concisely, in a single post; bridging the inferential distance may require something more like a sequence of posts. I may end up writing such a sequence eventually, since it would involve ideas I've actually been wanting to write up for some time, and which are actually relevant to more than just the specific questions at issue here (whether society should sponsor mathematics, and given that it does, whether paulfchristiano or anyone else in the LW readership should pursue it).
However, as the preceding parenthetical hints at, I'm actually somewhat conflicted about whether I should even bother. Although I believe that mathematical research should be conducted by somebody, it's not at all clear to me that the discipline needs more people beyond those who already "get" its importance, and are out there doing it rather than writing skeptical posts like paulfchristiano's. It seems perfectly plausible to me that those who feel as paulfchristiano does should just leave the profession and do something else that feels more "important" to them. This is surely the best practical solution on an individual level for those who think they have a better idea than existing institutions of where the most promising research directions lie, at least until Hansonian prediction markets are (ever) implemented.
Nevertheless, for those interested in the society-level question of whether mathematics (as such) may be justifiably pursued by anyone, or any community of people, as a professional occupation (which is quite distinct from the question of whether e.g. paulfchristiano should personally pursue it), I recommend, at least as a start, grappling with the arguments put forward by the best mathematicians in their own words. I think this essay by Timothy Gowers (a Fields Medalist), titled "The Importance of Mathematics", is a good place to begin. I would particularly draw the attention of those like paulfchristiano, who think they have a good idea of which branches of mathematics are useful and which aren't, to the following passage, from pp.8-9 (unfortunately the illustrations are missing, but the point being made is pretty clear nonetheless):