I assume they're referring to the top right quadrant of the graph being totally empty while the top left quadrant has two events. But those two events are a pretty slender reed to rest their analysis on.
What looks more interesting to me is an apparent downward trend in the biggest crater size from Chixhulub onwards. I tried downloading the Earth Impact Database data referenced in the paper so I could zoom in on these more recent impacts, but the dataset's only available as machine-unreadable HTML tables with various ad hoc notations. (This leads me to wonder how Ćirković, Sandberg & Bostrom turned these clunky tables of numbers into an unambiguous scatterplot, and makes me even more nervous about those two data points on which their analysis hinges.)
From a paper by Milan M. Ćirković, Anders Sandberg, and Nick Bostrom:
There cannot have been a large disaster on Earth in the last millennia, or we wouldn't be around to see it. There can't have been a very large disaster on Earth in the last ten thousand years, or we wouldn't be around to see it. There can't have been a huge disaster on Earth in the last million years, or we wouldn't be around to see it. There can't have been a planet-destroying disaster on Earth... ever.
Thus the fact that we exist precludes us seeing certain types of disasters in the historical record; as we get closer and closer to the present day, the magnitude of the disasters we can see goes down. These missing disasters form the "anthropic shadow", somewhat visible in the top right of this diagram:
Hence even though it looks like the risk is going down (the magnitude is diminishing as we approach the present), we can't rely on this being true: it could be a purely anthropic effect.