Applications are open for the 2026 Cooperative AI PhD Fellowship! The fellowship provides future and current PhD students in the field of cooperative AI with additional financial and academic support to achieve their full potential. Fellows will receive a range of benefits, including: * Research support including conference and compute...
TL:DR Join a global cohort of ambitious researchers in Cape Town for a fully-funded cooperative AI research fellowship! Spend 3 months from January to April 2026 researching with world-class mentors from Google DeepMind, Oxford, MIT, CMU, and Toronto, among others. Join us for an online information session on September 18th...
The development and widespread deployment of advanced AI agents will give rise to multi-agent systems of unprecedented complexity. A new report from staff at the Cooperative AI Foundation and a host of leading researchers explores the novel and under-appreciated risks these systems pose. Powerful AI systems are increasingly being deployed...
In this post, I outline some advice (and links to other advice) that I find myself giving increasingly frequently, despite having less and less time to do so. My hope is that in future I will be able to redirect people to this post. I also hope that, if nothing...
Applications are now open for the 2025 Cooperative AI PhD Fellowship! Fellows will receive up to $40,000 per year plus tuition fees, alongside many other benefits. Applicants should be enrolled or are about to be enrolled in a PhD programme at an accredited university (anywhere in the world), with a...
TL;DR: We introduce the first comprehensive theoretical framework for understanding and mitigating secret collusion among advanced AI agents, along with CASE, a novel model evaluation framework. CASE assesses the cryptographic and steganographic capabilities of agents, while exploring the emergence of secret collusion in real-world-like multi-agent settings. Whereas current AI models...
This work was facilitated by the Oxford AI Safety and Governance group, Cooperative AI Foundation, and Oxford Autonomous Intelligent Machines and Systems. Thanks also to Bart Jaworski, Jesse Clifton, Joar Skalse, Sam Barnett, Vincent Conitzer, Charlie Griffin, David Hyland, Michael Wooldridge, Ted Turocy, and Alessandro Abate. This blogpost accompanies the...