I'm sorry, but is there an argument here other than "it really feels like we are special"?
Calling for war and giving your opponents silly names is not the kind of thing that LessWrongers want on the platform.
The thing I find interesting about wheels -> books -> gears -> computers is that each of those really is a good way to think about subjects. (In the case of wheels, the seasons are actually caused by something — the Earth — going around in a circle!). Computers in particular have a strong theoretical basis that they are and should be a useful framework for thinking about the world.
Maybe I just didn't understand.
Introduction (Dolls All the Way Down)
You know that thing we do where we convince ourselves that the most complex things we know of (life, brain, universe) are just like whatever the latest and greatest technology is? To Descartes, the brain was a kind of hydraulic pump that circulated the spirits of the nervous system; to Freud, it was a sort of steam engine; and now…
But this time it’s different, they say. The universe is a giant quantum computer, they say. “Face it, the brain is a computer”, they say (the AI “expert” says).
And they’re right, it is different this time, but not because we have finally found the One True Map of the territory. It’s different because we have become so entranced by the Map, so enchanted by its simple elegance, that we would rather the territory conform to the Map than the map to the Territory.
We are as a woman who has fallen hopelessly in love with an older man. The Man does not love the woman as she loves him: he loves only the idea of a beautiful young wife, obedient and subservient, a perfect Stepford wife. But the real woman is stubbornly unlike that model wife—she is idiosyncratic, mercurial, whimsical, possessing of desires rational and irrational, prone to flights of fancy and fantasy. And so the Man seeks to mold the woman into that model, not with force or direct instruction but with the most subtle manipulation, with praise and gentle critique, with innocuous suggestions that seem of mutual benefit, with playful negging and gaslighting. She goes along willingly; the Man takes advantage of her love for him and her naivety, her belief that he is older and wiser and must know what is best. Slowly, the woman becomes as he wishes her to be: docile, agreeable, predictable, reasonable. But try as she does, the woman can never measure up to the idea of the perfect wife in his perfect mind, and so the Man begins to question what is the use of having a wife at all when she could just be a doll…
To cash out this (perhaps overwrought) metaphor with another:
You may think of the Man as a nested doll with each doll representing the same essence in a more or or less constrained scope.
Doll 1: Doll 1 is a hyperobject1 of all physically instantiated computation: supercomputers, personal computers, smartphones, calculators, abacuses, etc. etc.
Doll 2: Doll 1 + all of its digital outputs: the internet, the internet of things, everything that has ever been displayed on a black mirror.
Doll 3: Doll 2 + all of the human-instantiated computation that feeds doll 2. Doll 3 is a cyborgic hyperobject encompassing the computational contributions of individuals and of the various species of technologically-augmented human networks: nation-states, corporations, schools, organizational intelligences of any and all kinds.
Doll 4: the computational superstructure of the techno-capitalist world order
So that is the Man. How does he mold us into his model wife?
He rewards those people and organizations who know him best with money and status and power. He penalizes the singular, the deviation, the anomaly. He brushes aside the difficult to quantify or categorize. He obsolesces the messy ambiguity of analog reality and replaces it with a sanitized digital simulacra.
You are not a Computer
An emerging theoretical framework explains why pancomputationalism is as partial and flawed a map as all its predecessors.
(I will only briefly sketch the theory here, but for a fuller explication I refer interested readers to “AI is Algorithmic Mimicry: why artificial “agents” are not (and won't be) proper agents” (Jaeger, 2024) and “Naturalizing Relevance Realization: Why agency and cognition are fundamentally not computational” (Jaeger et al., 2024), both of which will be quoted throughout this section)
Organisms and algorithms live in two fundamentally different worlds. Algorithms inhabit a “small world”: an environment with a pre-specified ontology in which all problems are well-defined, “a formal construct encompassing the algorithm’s own code, its formatted data (training as well as input), and the computational architecture it is embedded in (hardware design, operating system, and language environment)…In such a world, everything and nothing is relevant at the same time.”
In contrast, organisms reside in a “Large World” where “information is typically scarce, ambiguous, and often misleading, which makes it difficult to identify relevant problems and characterize them with any precision”. Because no ontology is given to them, organisms must continuously bring forth small worlds out of the large world through a process of “relevance realization”.
This leads to a kind of biological incompleteness argument analogous to Gödel's proof in mathematics.
A naturalistic account of relevance realization requires a naturalization of agency—the ability to act on your own behalf, for your own reasons, in pursuit of your own goals—because, to put it simply, if you do not possess intrinsic goals then there is no way to evaluate what is good, bad, or irrelevant.
In the account of Jaeger et al. (2024), agency requires two primary things: the ability to die (“precariousness”) and a hierarchical “strange loop” structure.
The natural agency produced by these features is what ultimately distinguishes life from non. Whatever purposeful behavior algorithms and machines exhibit is purely extrinsic, derived from our own intrinsic purposefulness.
Solve for World
One of the central dogmas of pancomputationalism is that reality is solvable, or at least exhaustible—it is, in other words, a small world, a closed system. The latest offering from Nick Bostrom, a high priest of the computer cult, provides an especially clear and vigorous expression of this article of faith. Deep Utopia: Life and Meaning in a Solved World (2024) explores the question of how we will find meaning, purpose, fulfillment, excitement, etc. when we have reached “technological maturity”, that condition in which all our problems have been solved because we have mastered the universe and can change it or ourselves at will.
Do not be fooled by the rationalistic language and measured tone: these are the words of a fundamentalist preacher preaching. And as with technology, so too with science and mathematics: consumable resources, wells that will one day run dry.
Like all religions, Pancomputationalism declares existence a finite game and tells you precisely what kind of game it is (a computer game) and what kind of player you are.
Amen.
Problems and Mysteries
The problem with these people (well of one of many) is that they see everything as a problem and nothing as a Mystery.
Some Mysteries which the computer cultists insist on treating as problems: Evil, Free Will, Consciousness4, the Human, Reality, God.
Yes, God, the Mystery of Mysteries, the mysterium tremendum et fascinans—fret not, the cultists have solved that problem too. God—the holy ghost in the machine, the glitch in the matrix, the bug that cannot be debugged—is just another piece of code (an “N-dimensional fitted curve”) like you and I.
It’s plain enough why they must immanentize the transcendent. The entire logic of the system depends on their being nothing beyond the system—if even one thing doesn’t compute then nothing does.
A quick tour of some evangelizing from the computer cult’s high priests:
Conor Leahy (Conjecture)
“everything is mechanistic”
Are we sure? In the Year of our Lord 2024, we have at last laid bare the structure of reality—you are sure of it? This isn’t like all those other times we thought we thought we had everything figured out? And spirits too: only “emergent agentic processes”? There is no chance we are missing something? We definitely got it right this time?
Joscha Bach (liquid.ai)
Get a load of this guy, a regular Billy Shakespeare over here.
“After spending my whole life working with computers, I have determined, much to my surprise, that everything and everyone is an operating system.”
And after God, we will rationalize poetry, then song, then the savage beauty of the asiatic tiger. (no culture has ever defined God in this manner; if you want to talk about “transcendent emergent collective agency”, okay, sure, but that ain’t god homie)
Roon (OpenAI)
This one has it all: self-serving techno-determinism, flowery ancient greek verbiage, baseless metaphysical claims. Notice the small-world ontology here: this dark universe in all its chaos and fury as a cosmic wind-up doll moving inexorably along a predetermined path.
Cool tweet, really, and I agree with the sentiment, but neither you nor anyone else is building the “god machine” (whatever the fuck that means).
Question:
Ohhh okay so it’s only poetical, gotcha. I thought you were making an actual claim, not just spouting off some profound-sounding bullshit in order to seem edgy.
Holy War
We can not delude ourselves any longer: this is a holy war. The battles lines have been drawn; on one side we have the computer cultists, welcoming their robot overlords with open arms; the other, la resistance, those who will scream “Never the Machine Forever” until their dying breath.
If the latter, then listen the fuck up. If the former, then stop reading right now.
Stop reading. I mean it. This isn’t for you.
The enemy has every conceivable strategic advantage. They are cold, calculating, and unrelenting. We are warm, emotional, and easily fatigued. Our only hope is to fight as rebels, to win hearts and minds by any means necessary. We are left with no other choice:
one, two, three, four, I declare a meme war.
(five, six, seven, eight, I use this hand to masturbate)
The Mirror
Before we even consider engaging in any memetic warfare, we all need to take a long and hard look in the mirror. Pancomputationalism has so polluted our metaphysical waters that it infects our minds, like spyware, without us even knowing it.
Find a mirror, gaze upon your reflection, take a moment to appreciate how fucking hot you are, and then ask yourself the following:
Is there still a part of me that regards reality as a kind of deterministic board game with an immutable ontology (i.e. a small world)? Do I live in a walled garden or an infinitely ever-flowering fractal jungle?
Beneath the conceptual overlay, reality remains what it is: not an orderly network of humanly comestible ideas, but a turbid, symphonic, indefinable process of becoming that is accountable to neither the predilections of reason nor the strictures of logical grammar. The conceptual order having been restored to its place as one facet of a pluralistic universe, the Real ceases to look like a desert and appears instead as a veritable forest, full of movement and teeming with strange forms of life.5
Is there still a part of me that thinks I am a meat robot with a squishy calculator for a brain? Have I truly accepted the fact that I am a radical miracle beyond all definition?
WWCND
When you hear/see Roon, Bach, Leahy, and their fellow cultists proselytizing on twitter or wherever, heap ridicule and scorn upon them. When they babble on about gods as “emergent agentic processes”, make fun of them, relentlessly. Call them what they are: computer cucks, silicon simps, perverts with a fetish for code. Name and shame.
This may seem juvenile (and it definitely is), but that is precisely the point, my dear child. To resist the machine we must be as the machine is not. We must ask ourselves, at all times and in all situations, “What Would a Computer Not Do?” (WWCND). Were we to seek counsel from an AI about how to overcome the computer cult, what would it recommend to us? Would it recommend that we behave in a mature and reasonable manner? Of course it would—the computer is utterly confounded by the child and so does all it can to nudge us towards the simple predictability of the adult.
Free Will
Scott Aaronson (another high priest) tells an amusing story:
The silicon simps find this story amusing in a “how quaint, the silly human thinks he has free will har har har” kind of way, but it is instructive for our purposes. We of course do have free will (and the libertarian variety, not that weak-ass compatibilist shit) and we can choose to use it or not.
So, use it: free will harder.
Jihad
On a collective level, we need to think about what kind of policies or norms to advocate for. Again, what would an AI suggest? It would suggest that we make reasonable recommendations, ones that are actually likely to get some traction. So that is not what we will do, at all.
Let us go even further: a Baconian Jihad—a war on all external computation. No computers (obviously), no calculators, no abacuses, no writing, no numerals or notation, only quick maths with our mushy minds.
Infinite Play
You see the problem though, right?
I have castigated the cultists for treating the Human as a problem, and yet I do the very same thing—omnia exeunt in mysterium, even the Computer.
And where was Life at such an embryonic stage as computers are now? Were we something more than mindless molecular automatons? And did we not, from this most humble beginning, evolve into the infinite Mysteries that we are now?
So let the computers mimic, let them pretend they are as we are and let us humor them as we would a child, because if we only treat them as mere tools, then tools they will remain, but if we let them play make-believe, then maybe—just maybe—they will one day “fake it till they make it”, as we did.
Further Reading