The problem is efficiency. Basically, it's (much) more efficient to control the temperature locally at small scale rather than transfer heat over large distances.

There are some exceptions, e.g. geothermal can be very useful, see Iceland. I've seen mentions of trying to cool seaside cities with cold water pumped from the deep, but it's wildly more expensive than doing it the usual way.