tldr; It is incoherent to talk about a "you" which stretches through time.  Instead, we should think of a series of similar mind-moments.

Once upon a time, there was a little boy, who answered to the name Lucas Sloan and was scared of dying. I too answer to the name Lucas Sloan, and I remember being afraid of dying. Little Lucas wasn't scared of the present state of affairs, but it is fairly obvious that Little Lucas isn't around anymore. By any practical definition, Little Lucas is dead, he only exists as a memory in my mind and more indirectly in the minds of others. Little Lucas did not care that other people remembered him, he cared that he did not die. So what is this death thing, if Little Lucas was scared of it, but was not scared of the present situation?