Yes, that feeling is called abandonment. I suggest you keep an eye out for whether you devalue and/or idealize people too. If both those are the cases, you may have some personality quirks that are thought to cluster. In that case, mention that to your preferred expert and you can take it from there.