I don't think the quote is about favoring common sense over new shiny ideas. I think it's about how we tend to be lazy with words as long as we can get away with it -- until the words are completely wrong.

Dijkstra doesn't propose that novelty is avoidable. He admonishes us for describing it poorly.