Another way to think about it: suppose your timeline is forked, and in one fork you go on vacation. That timeline is subsequently terminated, after "the experience" happens. Leaving aside the moral issues of terminating a timeline (say, you have no choice in the matter, laws of physics force it, etc.), would you want the fork to happen? This should be easier to deal with, as it has zero consequences for the other timeline.
Yes? What are the consequences of not letting the fork happen?
I don't think I understand the riddle of experience vs. memory. I would daresay that means the concept is half-baked.
Within the TED talk, Daniel Kahneman poses the probably familiar philosophical quandary: if you could take a beautiful vacation and afterwards your memory and photo album was completely erased, would you still do it? Whether you would still do it illustrates whether you live in service of the experiencing self instead of the remembering self.
Part of what prevents me from understanding the riddle is that I believe vacations are worth more than the memories and photos: vacations change you.
Maybe you could argue that this change is also a form of memory in service to the remembering self, but I'm not sure that's what he meant. In his thought experiment on vacations he asks if you would still take a vacation if, at the end of it, you forgot the whole thing and all of your photos were deleted.