"The best way to predict the future is to invent it." -- Alan Kay (and/or others.)
Seems a pretty straightforward extension of Goodhart's Law. Every measure is an incentive, with all the alignment and agency problems that come along with it.
The Alan Kay quote reminds me of my thermo prof saying, "Engineers love to control a process. That way, we don't have to understand it." I've always loved that one, but Alan Kay says it better.
Nick Szabo writes about the dangers of taking assumptions that are valid in small, self-contained games and applying them to larger, real-world "games," a practice he calls a small-game fallacy.
This last point, which he expands on later in the post, will be of particular interest to some readers of LW. The idea is that while a prediction market does incentivize feeding accurate information into the system, the existence of the market also gives rise to parallel external incentives. As Szabo glibly puts it,
Futarchy, it seems, will have some kinks to work out.