I tend to see Knightian unpredictability as a necessary condition for free will
But it's not. (In the link, I use fiction to defang the bugbear and break the intuition pumps associating prediction and unfreedom.) ETA: Aaronson writes
even if Alice can’t tell Bob what he’s going to do, it’s easy enough for her to demonstrate to him afterwards that she knew.
But that's not a problem for Bob's freedom or free will, even if Bob finds it annoying. That's the point of my story.
"Knightian freedom" is a misnomer, in something like the way "a wine margarita" is. Except that the latter at least contains alcohol, something one usually wants from a margarita. Sometimes it's good to be predictable (coordinating with friends); sometimes it's bad (facing enemies). But at no time is it crucial to freedom. Prediction isn't control.
None of this is to deny the potential interest of Aaronson's arguments regarding the feasibility of brain scanning, etc. But calling this Knightian unpredictability "free will" just confuses both issues.
Downvoted for extremely uncharitable reading of the paper.
Scott Aaronson has a new 85 page essay up, titled "The Ghost in the Quantum Turing Machine". (Abstract here.) In Section 2.11 (Singulatarianism) he explicitly mentions Eliezer as an influence. But that's just a starting point, and he then moves in a direction that's very far from any kind of LW consensus. Among other things, he suggests that a crucial qualitative difference between a person and a digital upload is that the laws of physics prohibit making perfect copies of a person. Personally, I find the arguments completely unconvincing, but Aaronson is always thought-provoking and fun to read, and this is a good excuse to read about things like (I quote the abstract) "the No-Cloning Theorem, the measurement problem, decoherence, chaos, the arrow of time, the holographic principle, Newcomb's paradox, Boltzmann brains, algorithmic information theory, and the Common Prior Assumption". This is not just a shopping list of buzzwords, these are all important components of the author's main argument. It unfortunately still seems weak to me, but the time spent reading it is not wasted at all.