I think you are making an unjustified assumption, e.g. "... that I will pop into existence again...", that there is an "I". There is a pattern of information that feels that it experiences qualia, and then later possibly there is another pattern of information that feels that it experiences qualia, and possibly with additional information representing memories corresponding to the first set of information. Shifting to this viewpoint dissolves the question. If we accept that qualia is an illusion then we still have an interesting question about how the illusion occurs, but many other tricky issues go away.