= 27d567bc2d48d9f40e9ccc20ea370b15)
Lumifer comments on The track record of survey-based macroeconomic forecasting - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
= 783df68a0f980790206b9ea87794c5b6)
Loading…= b715d02e85f7b3b4ae65ca3d3e450868)
Subscribe to RSS Feed
Powered by Reddit
= f037147d6e6c911a85753b9abdedda8d)
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (7)
Actually, such numbers are usually determined through sampling. They are also subject to definitions and methodologies change (see e.g. inflation).
What does this mean? Specifically, what are your definitions and criteria of being "biased" and "inefficient" in this context?
Sounds like No True Scotsman :-/
Yes, you're right that it's not possible to measure everything, so sampling is often used in lieu of direct measurement. I had mentioned sampling in my earlier post.
I'm using the same definitions as used in the literature. The "bias" concept is discussed in the cited papers, plus in my earlier post http://lesswrong.com/lw/k2a/the_usefulness_of_forecasts_and_the_rationality/
The "efficiency" criterion is more difficult to define, but here it means roughly "makes use of all the available information" -- sort of synonymous with rationality.
The meanings of the terms are of course up for debate, and the different papers don't quite agree on the right meaning.
It's certainly a flaw that they can't predict shocks, but to the extent that a few shocks explain most forecasting error, that would have different implications than if the forecasts were wrong in all sorts of small ways.
The "insufficient information" refers to the quality of existing data they have access to. In some cases, people made wrong forecasts because the data about current indicator values that they were working with had errors, or was incomplete (e.g., they didn't have information on a particular indicator value for a particular month).
How do you know? Or, more explicitly, on the basis of which evidence are you willing to make the claim that consensus macro forecasts "make use of all the available information"?
Besides, just having information is necessary but not sufficient. You also need models which will take this information as inputs and will output the forecasts. These models can easily be wrong. Is the correctness of models used included in your definition of efficiency?
It is difficult to conclusively demonstrate efficiency, but it is easy to rule out specific ways that forecasts could be inefficient. That's what the papers do.