It's worth us worrying about as far as our future is concerned, but to be the sole explanation of the Fermi Paradox (rather than just a contributing factor) it would have to have happened to at least an overwhelming majority of extraterrestrial civilizations, many of whom would presumably have considered the problem beforehand.