Let's imagine that it works like that for one segment of the population, but for another segment it never stops feeling awful and doesn't have the same fitness effects.

I'm in a segment where it does have fitness effects, but never stops feeling awful. I was in the Army, and it was possible for me to meet the physical fitness standards, but even exercising strenuously every day during eight weeks of Basic Training never produced the exercise high that people speak of.