Cross-posted from my website. As of a few months ago, I had this simplified mental model where either AI developers race ahead and kill everyone, or we coordinate a pause and things go okay. But my old mental model underrated the likely possibility that we get a global pause on...
Many people support stricter regulations on frontier AI, and some of those people donate to political campaigns for pro-regulation candidates. Not many people oppose AI regulations, but that group includes AI companies and execs who have giant piles of cash to throw at super PACs. This situation is made possible...
TLDR: Take the population ethics quiz here: https://mdickens.me/pop-ethics/ Population ethics is an oft-overlooked subfield within ethics. Many people hold views that they don't realize contradict each other, or that have strange implications that they wouldn't endorse if they thought about it more. Not just that—population ethics is a BIG DEAL....
I continue to believe we should pause frontier AI development. Any discussion of alternative strategies should be thought of as planning for contingencies. A unifying driver behind many post-alignment risks—catastrophic risks that remain even if we solve the alignment problem—is that by strong default, ASI would end liberal democracy. Liberalism—in...
To achieve the best possible future, we must know what that future looks like. In other words, we need to solve ethics.[1] The problem of solving ethics is so large and abstract that it’s difficult to say useful things about. In lieu of any structured analysis, herein lies a collection...
Cross-posted from my website. Some people think we should pause AI, but not now. They say we should wait until AI reaches human level, [1] because: * It's not (catastrophically) dangerous until after then. * Human-level AI will help us do safety research. Alternatively, other people (like me) think we...
Cross-posted from my website. I continue to believe we should pause frontier AI development. Any discussion of alternative strategies should be thought of as planning for contingencies. "Super-persuasive" AI is dangerous because a misaligned ASI could persuade humans to help it take over. But setting that aside, even if we...