Due to exponential growth in the computing industry, we can assume that the majority of flops were shipped in the last few years. NVidia and AMD shipped over 12 million graphics cards last year. (Note this analysis excludes laptop chips, but includes datacenters.) If we take an NVidia GeForce RTX 2080 (20 Teraflops for half-floats) as a typical card, we can estimate that less than 12M * 20T * 5 = 1.2e21 flops were shipped as GPUs in the last five years, and we can assume that is the vast majority of GPU flops in active use today.

How are those GPUs utilized? Presumably, most are used in either personal computers or datacenters, with datacenters breaking down into ML (research/deployment), cryptomining and other uses I'm not aware of. Cryptomining may or may not be a significant fraction of the total. Gamers are very pissed at miners for "hoarding all the cards," and all the industry players have reasons to obscure what is really going on in this industry, so we might not have accurate information.

I wanted to run a Fermi estimate on x86 CPUs for comparison but I couldn't find the right information. (I didn't look very hard.) I did find that about 27 billion ARM chips were sold in 2020. ARM chips vary widely, with at least some having >1000 Gflops but others having <10 Gflops. Using a conservative estimate, 27B * 10B * 5 = 1.35e21, suggesting that there are more flops in low-power embedded applications than in GPUs.

One way to maybe shed some light on this is to sort the latest Top500 results by location (maybe with extra work to get the specific locations inside the country, if required). There is a very long tail but most of it should correlate with investment in top infrastructure. Of course certain countries (US, China) might have undeclared computing assets of significant power (including various private datacenters), but this probably doesn't change the big picture much.