Samuel Knoche

Summary: Current AI systems possess superhuman memory in two forms, parametric knowledge from training and context windows holding hundreds of pages, yet no pathway connects them. Everything learned in-context vanishes when the conversation ends, a computational form of anterograde amnesia. Recent research suggests weight-based continual learning may be closer than commonly assumed. If these techniques scale, and no other major obstacle emerges, the path to AGI may be shorter than expected, with serious implications for timelines and for technical alignment research that assumes frozen weights. Intro Ask researchers what's missing on the path to AGI, and continual learning frequently tops the list. It is the first reason Dwarkesh Patel gave for having longer AGI timelines than many at frontier labs. The ability to learn from experience, to accumulate knowledge over time, is how humans are able to perform virtually all their intellectual feats, and yet current AI systems, for all their impressive capabilities, simply cannot do it. The Paradox of AI Memory: Superhuman Memory, Twice Over What makes this puzzling is that large language models already possess memory capabilities far beyond human reach, in two distinct ways. First, parametric memory: the knowledge encoded in billions of weights during training. Leading models have ingested essentially the entire public internet, plus vast libraries of books, code, and scientific literature. On GPQA Diamond, a benchmark of graduate-level science questions where PhD domain experts score around 70%, frontier models now exceed 90%. They write working code in dozens of programming languages and top competitive programming leaderboards. They are proficient in most human spoken languages and could beat any Jeopardy champion. Last year, an AI system achieved gold-medal performance at the International Mathematical Olympiad, and models are increasingly reported to be helpful when applied in cutting-edge math and physics rese