Thank you for introducing me to dynamic (in)consistency, that is extremely helpful for resolving my understanding of will power. I have similar experiences as you describe: except in occasions of grave illness, I experience my will as infinite, and any appearance of depletion/giving up seems to arise from a divided will (eg wanting to keep riding until 2 hours is up vs wanting to be able to move without pain tomorrow)
Dynamic consistency seems like an incredibly worthwhile area to self-improve in.
How would one go about improving in that area? I can't see a straightforward way to do it.
Stanford Report has a university public press release about a recent paper [subscription required] in Psychological Science. The paper is available for free from a website of one of the authors.
The gist is that they find evidence against the (currently fashionable) hypothesis that willpower is an expendable resource. Here is the leader:
(HT: Brashman, as posted on HackerNews.)