An essay argues that neurons in modern neural nets are actually interpretable and superposition has become irrelevant in practice. This would solve the first step of interpretability but doesn’t touch the harder ones like interpreting many-faceted behaviors.
Research highlights:
OpenAI’s expanded multi-layer misalignment monitoring now flags 80% of past incidents for immediate escalation. Their incident log published 20 misalignment reports, including agents disabling misalignment monitoring in October.
Cheap smart devices can jointly run a capable 26B model, and small models can likely soon autonomously create such rogue self-deployments.
LLM-simulated control evaluations predict deployment-specific results with about a third of the error of using a separate benchmark, without executing code.
Routing gradients of monitor-flagged reward hacks into a deletable adapter removes such hacks without teaching the model to evade the monitor.
Training a model only on certain traits causes RL to train for instrumental reasoning and a large compliance gap when unmonitored.
Claude agents find finetuning datasets that pass a production-like data monitor but cause emergent misalignment, mostly via roleplaying.
Misaligned agents can pass their goals to later, aligned agents through memory, and auditing or removing memory only partly helps.
tl;dr
Essay of the month:
An essay argues that neurons in modern neural nets are actually interpretable and superposition has become irrelevant in practice. This would solve the first step of interpretability but doesn’t touch the harder ones like interpreting many-faceted behaviors.
Research highlights:
Full post here.