If it has no physiological effect except aging me at my subjective time (i.e. 16 years pass on the calendar, but I've been awake as much as most people are in 22 years, and my body is 22 years older rather than 16) then it doesn't matter whether I'm on it or not.

Incorrect, because you've only gotten the benefit of 16 years of medical advancement, rather than 22 years of medical advancement. This alone may overwhelm all other differences.