I notice that people (including me) are especially prone to this in economics.

First, no area is as bad as sports :) Now, I don't know much about economics, but let us assume for the moment that it is a real natural science and it is impossible to get to the leading edge without investing thousands of hours of hard work, then repeating and alieving the mantra I have suggested in the OP would be my recommendation. One way to convert this belief into alief could be looking through the relevant textbooks and realizing that you cannot possibly understand the advanced stuff without learning the basics first. And real-life economic policy is probably as advanced as it gets. Sort of an economic version of this.

Now, it is not necessarily true that economics is like other natural sciences, or like law or medicine. Maybe it is more like alchemy and what the subject matter experts learn over a decade or two does not help at all with giving sound economic advice. Maybe one or two terms is enough, and the rest is just fluff. I don't know. But this point ought to be addressed first, somehow...