This has been a collaborative effort between UK AISI, Redwood Research and various other orgs! Today, we’re launching ControlArena, a library for running AI control experiments. As AI systems become more powerful and autonomous, ensuring that they remain under human control is one of the central challenges of AI security....
The Alignment Project is a global fund of over £15 million, dedicated to accelerating progress in AI control and alignment research. It is backed by an international coalition of governments, industry, venture capital and philanthropic funders. This post is part of a sequence on research areas that we are excited...
The Alignment Project is a global fund of over £15 million, dedicated to accelerating progress in AI control and alignment research. It is backed by an international coalition of governments, industry, venture capital and philanthropic funders. This sequence sets out the research areas we are excited to fund – we...
This has been a collaborative effort between UK AISI, Redwood Research and various other orgs!
Today, we’re launching ControlArena, a library for running AI control experiments.
As AI systems become more powerful and autonomous, ensuring that they remain under human control is one of the central challenges of AI security. If powerful AI systems cannot be reliably expected to follow the intended goals of developers, it will be necessary to develop mechanisms to detect or correct unintended behaviours. AI control is an emerging research agenda which seeks to address this problem. While alignment research focuses on preventing unintended behaviours, control research explores how to maintain oversight and containment even when systems are misaligned.
AI control... (read 745 more words →)
The Alignment Project is a global fund of over £15 million, dedicated to accelerating progress in AI control and alignment research. It is backed by an international coalition of governments, industry, venture capital and philanthropic funders. This post is part of a sequence on research areas that we are excited to fund through the The Alignment Project.
Apply now to join researchers worldwide in advancing AI safety.
Problem statement: Current alignment methods can’t guarantee that an AI’s goals and actions match human intentions (Carlsmith, 2023). In the future, we might rely heavily on AIs performing autonomous work such as automated alignment research. At the capability level sufficient to do such research, these... (read 5158 more words →)
The Alignment Project is a global fund of over £15 million, dedicated to accelerating progress in AI control and alignment research. It is backed by an international coalition of governments, industry, venture capital and philanthropic funders.
This sequence sets out the research areas we are excited to fund – we hope this list of research ideas presents a novel contribution to the alignment field. We have deliberately focused on areas that we think the AI safety community currently underrates.
Apply now to join researchers worldwide in advancing AI safety.
For those with experience scaling and running ambitious projects, apply to our Strategy & Operations role here.
In-scope projects will aim to address either of the... (read 503 more words →)
Does anyone have an update/ thoughts, on how safe it would be to take walks with asymptomatic friends one on one and keeping a distance of about 6 feet ?
Asymptomatic transfer pointer. Saw in an ea Fb group claims ~ 15% household asymptomatic household transfer rate https://www.medrxiv.org/content/10.1101/2020.03.03.20028423v1?fbclid=IwAR14euEgPp3UvxBI2zSk-ZPCbbBzEV8JbyVVofxdgwqJDkRBoVKzREJdM4w