The whole idea of optimisation is controversial among some people because they see it as the opposite of being yourself.

Someone else brought up the weird edge case that it's possible to exercise too much, and that if you're in such a position then more exercise will shorten, not lengthen, your life

It's no weird edge case. If I remember right there was a recent study that came to that conclusion that went through the media.