Yeah, realize there's not as much description as there could be. Basically a new camp in the 3 sided AGI debate (safety, boosters, ethics). Here's a relevant excerpt:
There are already people who believe that the decisions made about this technology should not be left to those currently making them. Contrary to those who dismiss AI as a “stochastic parrot,” they take AI’s potential seriously. And contrary to classic AI safety, they recognize that there will be no purely technical “solutions” to the problems AI presents. Instead, they see governance as the essential lever. In this book, I’ll call them AI reformers.
Deep learning is incredibly powerful, but it’s being pointed at the wrong things by the wrong people for the wrong reasons. Indeed, its potential actually means it’s even more important that we change how it’s developed. The Obsoleting Project occasionally produces genuine breakthroughs—in medicine, in science—but these are the scraps that fall from the table, not the meal itself. This isn't an accident; it's just what markets reward.
Many people on the right and left would like to just press stop on AI. They hate what it’s done to the internet, they hate having it foisted upon them, and they hate the people making it. I get it. Really. (I miss being able to use em-dashes without drawing suspicion, and, sometimes, a sentence structure really isn’t just this, it’s also that!) But this understandable revulsion can blind us to the staggering potential of a reformed AI, where the immense power of deep learning is applied not to produce slop and madness, but to enable scientific discovery and unambiguously better lives—more AlphaFold and less chatbot psychosis.
Crucially, reformers recognize that AI's present harms and its potential catastrophes aren't separate problems requiring separate approaches—they're symptoms of the same underlying dynamics: competitive pressure, concentrated power, and a staggering lack of accountability. The chatbot that encourages a teenager's suicide and the hypothetical superintelligence that slips human control both emerge from organizations racing to deploy systems they don't really understand. Getting serious about one means getting serious about the other. Reformers recognize that, if it were aimed in different directions, the technology could be so much better than it is. They realize that the people advancing the Obsoleting Project—not the various people looking to change or stop that project—are the ones with the real power, at least for now. They believe that a better world is possible, and so is better AI. In short, AI reform works toward the version of AI that the Obsoleting Project sells, but doesn’t actually make.
Interesting. Thanks for explaining.
Just thought I'd share a post I wrote about the potential promise of a "wisdom explosion" in case that's of interested to you - I'm unsure, but I see some potential resonance/synergy with your perspective - https://aiimpacts.org/some-preliminary-notes-on-the-promise-of-a-wisdom-explosion/ .
I wrote a book! It’s called Obsolete: The AI Industry's Trillion-Dollar Race to Replace You—and How to Stop It, and it’ll be available in May if you preorder through my publisher (OR Books+The Nation).
With it, I took on a dual mission: get anyone up to speed on the state of AI and its risks (especially skeptics and lefties) AND write something people working in the space will enjoy and learn from. An unbiased panel of early reviewers (i.e. people I know) think it succeeds. For instance, here’s a review from a skeptical friend:
If you want to help the book, the most useful thing you can do right now is preorder and encourage others to do the same. preordering through my publisher gets you the book in May (weeks before wide release June 23) and shows there's an audience, which matters as we try to get it in front of more people. It also gets you 15% off!
And if you’d like to share it on socials: Twitter, Bluesky, LinkedIn, Threads. If you have a podcast, newsletter, publication, or other platform where you might cover the book, email press@obsoletebook.org and include a bit about your work to request a review copy.
In a nutshell, the book is about the largest project in history: the attempt to render you obsolete. The thing I wrestled with the most was: what the hell are we supposed to do about it? When you lay out all the potential horrors presented by the advent of machines that can fully replace human labor, there is really only one answer that adequately avoids them: stop. This, however, is anathema to the people that need to be convinced, so I, like many others, tried to find proposals that would help improve our chances that things go well that wouldn’t get me written off as naive (e.g. “Build a pause button”).
But in an effort to be taken seriously by Very Serious People, I wasn’t actually being serious myself. And the people in charge aren’t going to do what’s needed unless enough of us demand it of them.
Of course, thinking about what I refer to in the book as the “Obsoleting Project” is a tricky business. The best reason to believe it might succeed is also the best reason to think our obsolescence is inevitable: the unprecedented scale of the resources pouring into it. Could it really be stopped? The first person I needed to convince was myself. Researching the book, especially how the Nuclear Freeze movement got Reagan to about-face on arms control (covered in the final chapter), paired with watching concern about AI explode into the public consciousness, convinced me that stopping is ambitious, but eminently achievable.
Obsolete draws on hundreds of conversations with leading AI researchers, advocates, and industry insiders (including Geoffrey Hinton, Yoshua Bengio, Daron Acemoğlu, Eliezer Yudkowsky, Shane Legg, Helen Toner, Deborah Raji, Stuart Russell, Ajeya Cotra, Daniel Kokotajlo, and Dan Hendrycks).
A lot has changed in the last few years, and it was painful to largely sit out The Discourse the past six months as both I, and seemingly the world, entered crunch time. But it would have been far more painful to not write the book at all, because it’s become increasingly clear that there’s an Obsolete-shaped hole in the discourse.
The book covers core concepts from AI safety, but also where they fall short, while proposing entirely new ways to think about it. Here are some of the ideas I’m most excited about:
My wildest dream is that Obsolete can do for AI what Silent Spring did for environmentalism or Unsafe at Any Speed did for consumer safety. The book is written, the timing is perfect, and the big question-mark is whether it makes a big enough splash. I’m doing everything I can to make that happen, but could use all the help I can get
Ways to help
Preorder it!
Share it. Word-of-mouth from people who already get it is the launch's highest-leverage channel.
Leave a Goodreads review once you've read it. Amazon doesn't allow reviews before release, so save the Amazon review for June 23 or after—please leave one then too, even if you got the book through OR direct (it'll be marked "unverified" but still counts). Both matter: Goodreads helps with early word-of-mouth, Amazon reviews matter most in the first weeks after wide release.
Criticize the book in public. You’ll quickly find that Obsolete is not orthodox AI safety translated for a lay audience. One of the most exciting things about getting a lot of attention on the book is getting a chance to red team these ideas and improve upon them.
Bulk orders for groups. If you organize a reading group, university group, workplace book club, or want to gift copies, my publisher OR Books offers tiered discounts (20% off 5-49, 30% off 50-99, 40% off 100+). Email bulk@obsoletebook.org. Note: bulk orders go great for distribution but generally don't count toward bestseller rankings, so the highest-leverage thing for the launch is still individual preorders.
If you want to do more—host a reading group, help with coverage, organize an event, write a review—there's a form on the book site that lets me triage offers and follow up properly: https://www.obsoletebook.org/#help
If you have a specific high-leverage intro (a major podcast host, a member of Congress, a movement organizer doing serious work), email me here: press@obsoletebook.org
Table of contents
Part 1 - What You’ve Heard
Prologue - The Obsoleting Project
Chapter 1 - What is Artificial Intelligence?
Chapter 2 - Is AI a Bubble?
Chapter 3 - Will the Robots Take Our Jobs?
Chapter 4 - “Just Unplug It”
Chapter 5 - “Increasingly Smart Sociopaths”
Chapter 6 - Why Build the Doom Machine?
Chapter 7 - Is AI Impossible?
Chapter 8 - The “Doomers” Feel Misunderstood
Chapter 9 - Is AI Inevitable?
Interlude - Chapter 10 - Moving Fast and Breaking Minds
Part 2 - How It Could Go
Chapter 11 - The Wrong Kind of AI
Chapter 12 - The Problems with the Alignment Problem
Chapter 13 - How Fast Could It Happen?
Chapter 14 - The Best-Case Scenario
Chapter 15 - How We Could Lose
Part 3 - What to Do
Chapter 16 - Stopping the Obsoleting Project
Chapter 17 - Actually Democratic AI
Chapter 18 - What Should the Rest of Us Do About It?
Excerpt - The Obsoleting Project
A tiny group of people, backed by the best-resourced organizations in the world, is attempting to render humanity obsolete. Not every participant in the project even believes this is possible, but the effort's vanguard has defined itself through its faith in the transformative potential of machine intelligence and its willingness to forge ahead despite the grave risks it so routinely acknowledges.
The industry’s ultimate goal and the most controversial term in this space—artificial general intelligence—conjures up images of a new type of mind that might think like our own. But it would not. And “AGI” keeps the focus on what it might be, when the attention should really be on what it might do. It would be better to understand what companies like OpenAI, Anthropic, and Google are trying to build not as a new type of brain, but rather a new type of machine, one that doesn’t make products or services, but produces labor itself.
Why? Humans—and human-derived labor—are messy. Humanity has always been constrained because humans are the constraint. It takes a long time to make more of us, to educate us, to feed and shelter us. We can only do so much. For centuries, automation has allowed owners to substitute some capital for labor—the tractor for the scythe, the loom for the needle—but only to a point.
Now, machine intelligence promises the potential to cut out that last constraint: us. This obliterates the one fundamental limit and opens up new worlds of possibility. Many of them, as we will see, are terrifying.
The leaders of what, in this book, I’ll call the Obsoleting Project may contest this framing, offering some bromides about how AI will augment human work or how we’ll simply find new jobs to do. But their stated goals are to create systems that so clearly surpass our abilities that we will have little hope of competing. OpenAI makes this explicit, defining AGI as “a highly autonomous system that outperforms humans at most economically valuable work.”
Many are skeptical that the Obsoleting Project will succeed. Perhaps you are too, and I don’t blame you. Often, seemingly equally credentialed people are making opposite claims about the present and future of the technology. But the Project’s scale has no real precedent. What we think of as big—Gilded Age monopolies, the Manhattan Project, the Apollo program—doesn’t even come close to capturing its size. It’s worth looking carefully at whether it has a chance of succeeding.
As with all new technologies, the Obsoleting Machine, if it works as intended, will create winners and losers. If you’d like to double down on today’s biggest winners—the ones developing it, the capital-owners, and the bosses, along with the nations and fortunes large enough to buy a seat at the table—then bring on the acceleration. The Obsoleting Project is, essentially, an inequality engine, aspirationally turning unfathomable amounts of capital into other people’s unemployment, all to maximize value for shareholders. The crowning irony: the Project was built on the backs of humanity’s collective labor, appropriated wholesale—our shared inheritance plundered to create private fortunes.
Understanding these dynamics—who wins, who loses, and why—is essential to grasping what's actually happening right now, and what might happen next. Other books have been written about machines that might one day think. This is the first book about machines that might one day produce labor.