The military example of being confused about what to be confused about makes me think there is a confusion equivalent of the knowns. From the famous quip:
Known knowns
Known unknowns
Unknown knowns
Unknown unknowns
It feels like the transition from unknown to known probably looks like this:
Confused confusions (an unknown)
Confused deconfusions
Deconfused confusions (these seem like what we have been calling 'disentangled' in Agent Foundations)
Deconfused deconfusions (a known)
There is an idea I have used by implication in the OP, but might benefit from being identified specifically. This idea is that the level of abstraction where a concept is applied matters.
To illustrate what I mean, consider the end of the confused statements quote from the MIRI post:
Today, these conversations are different. In between, folks worked to make themselves and others less fundamentally confused about these topics—so that today, a 14-year-old who wants to skip to the end of all that incoherence can just pick up a copy of Nick Bostrom’s Superintelligence.
I think it would be reasonable for someone reading my post to look at that section of the MIRI post and then ask: so what is the Superintelligence of strategy? My answer is that there isn't one yet; this is what Sun Tzu and Clausewitz tried and failed to accomplish. I don't believe we have a good enough understanding of the component disciplines of strategy to write one, either (consider our mastery of computer science and information theory relative to our mastery of political science, economics and psychology). We are too confused.
I think the key insight of Meiser's approach is that he applies scientific reasoning as a generative rule for a strategy instance, rather than trying to describe a science of strategy in general and leaving the instance as an exercise for the reader. In other words, he took the scientific perspective and aimed it one layer of abstraction down. This allows us to account for confusion.
The level of abstraction is a big reason deconfusion is so awesome: it works no matter where you aim it, even aiming-at-aiming.
Reading the New Research Directions update from MIRI, I was struck by the description of deconfusion:
I find this concept deeply impressive. I have also lately been considering the problem of strategy or lack thereof, so the idea popped up almost immediately: strategy is deconfusion in the action domain.
I'm going to draw on three sources for this post: the first is the aforementioned New Research Directions post from MIRI; the second is a paper from Parameters 46 Winter issue by Jeffrey W. Meiser, "Are Our Strategic Models Flawed? Ends+Ways+Means = (Bad) Strategy"; the third is an article from November 2012 in The Atlantic by Thomas E. Ricks, "General Failure." I recommend them all individually, but I won't assume you have read them.
Returning to the concept of deconfusion, it is easy to change the quoted section only a little to capture what I mean:
I think this is an important connection to draw. There is a lot of information available on strategy: each military philosopher of note supports an entire corpus of commentary, and likewise for every conqueror; every war has lots of official and academic analysis done on its results; there is an absurd profusion of filtering the military and historical information through the lens of self-help or business-speak. It has all very consistently failed to guide the development and execution of good strategies, and I think deconfusion does a good job of pointing to why.
Failure to Notice Confusion and the Lykke Model
Meiser's paper is about the current norms in the US military and the Army in particular. The focus of the paper is the Lykke model and the ways in which it encourages bad strategy. It consists of the following:
The problem in practice, Meiser argues, is that strategy development is dominated by means-based planning. This is because the theory is from 1989, developed in reaction to the failures of the Vietnam War; the thinking went that if resource constraints were better taken into account, we could prevent "unrealistic strategies." Ends are treated as given and what people mostly do with planning is look at the means table, match them against the ends table, and then call it a day. The problem with the model is that it promotes a kind of plug-and-chug approach.
Meiser uses General Stanley McChrystal's plan for Afghanistan after he took command of that theater as an example:
The debate was actually moot. No one knew how to really use those resources, and the military did not notice their confusion about the problem. Of course, this is not the only shortfall.
Assuming Confusion Away
Returning to the MIRI post, this is given as an example of confused thinking about AI risk:
From the Atlantic article, quoting a slide from a classified briefing:
Comparing these two is only marginally appropriate; the first quote is from (at the time) amateurs who were deeply engaged with the problem they were thinking about, whereas the latter is from nominal experts who were negligently hand-waving the problem away. I say that both suggest confusion about how to consider the problems at hand. I go further and say that the latter is a more pernicious sort of confusion, because they assumed there never was any from the beginning.
Also from Ricks, regarding General Tommy Franks at the beginning of the Iraq War:
This did not improve as the war went on:
Nor was it a problem unique to Franks. Regarding his successor, Lieutenant General Ricardo Sanchez:
Eventually on the third try someone noticed that they were confused about what the Army was doing, in the person of General George Casey:
But he, too, took the ends as both given and uncomplicated. While Baghdad was in the throes of civil war:
From the beginning of the conflicts in both Afghanistan and Iraq, the possibility of being confused about the goals was not seriously considered, because the military assumed the problem away.
Theory of Success and Re-enter Deconfusion
Current strategy norms don't admit the idea of confusion, which is a problem. In Meiser's paper he offers a different definition of strategy which he hopes will promote "creative and critical thinking," which I have taken the liberty of interpreting as addressing the confusion problem. Pleasingly he moves into terms and concepts we are familiar with (emphasis mine):
This puts strategy on the same type of conceptual ground that motivated deconfusion in the first place; it is the primary reason I see deconfusion being so valuable. A secondary reason I see deconfusion as being valuable is shifting from the current paradigm. Currently formal strategic methods don't account for confusion, and lazy or negligent approaches to those methods can make it impossible to resolve. Viewing deconfusion as fundamental means that my assumption is that I am confused.