I said that very few people are doing too much exercise (tacitly, relative to the number of people who are doing too little), to which someone replied that they had once overtrained to their detriment, as if this disproved my point.

There's this issue though -- what matters is not the fraction of people who exercise too much among the general population, is the fraction of people who exercise too much among the people you're telling to exercise more to.