limitstocontrol.org Intro Can we keep enough control over AI? If systems are developed to be more and more autonomous, this is no longer a given. It's a hypothesis, calling for serious investigation. Even alignment relies on control. Researchers build mechanisms to control AI's impacts in line with human values. So...
Do you have AI Safety research ideas that you would like to work on with others? Is there a project you want to do and you want help finding a team? AI Safety Camp could be the solution for you! Summary AI Safety Camp Virtual is a 3-month long online...
Roman Yampolskiy (Summary by Karl von Wendt and Remmelt Ellen) This is a summary of the paper “On the Controllability of Artificial Intelligence: An Analysis of Limitations”, which shows that advanced artificial general intelligence (AGI) with the ability to self-improve cannot be controlled by humans. Where possible, we have used...
Can we keep enough control over AI? If systems are developed to be more and more autonomous, this is no longer a given. It's a hypothesis, calling for serious investigation. Even alignment relies on control. Researchers build mechanisms to control AI's impacts in line with human values.
So how must a control mechanism operate? What limits its capacity to track and correct all the AI signals/effects? Does it provide enough stability, or give way eventually to runaway impacts?
We explore these questions in a new field: Limits to Control.
This in-person workshop is meant to facilitate deep collaboration. We're bringing together researchers to map the territory of AI control limitations – to understand the... (read 606 more words →)
Do you have AI Safety research ideas that you would like to work on with others? Is there a project you want to do and you want help finding a team? AI Safety Camp could be the solution for you!
AI Safety Camp Virtual is a 3-month long online research program from January to April 2025, where participants form teams to work on pre-selected projects. We want you to suggest the projects!
If you have an AI Safety project idea and some research experience, apply to be a Research Lead. If accepted, we offer some assistance to develop your idea into a plan suitable for AI Safety Camp. When project plans are ready, we open... (read 1167 more words →)
On the weekend of April 27th-28th, our AI Safety Camp teams will present their project findings in 10-minute talks.
Join on Zoom
You are welcome to join any talk! Teams are sharing their findings in mechanistic interpretability, in agent foundations, on legal actions to restrict AI, and many other areas.
The talks will be arranged in 5 blocks. Each block consists of 5-6 short talks, followed by breakout rooms for questions and further discussions.
You can find the schedule here, and the summaries/abstracts for the projects/talks here.
You can find summaries of the original project plans here. Keep in mind that some projects will have changed over the course of the program, and a few projects got cancelled.
Roman Yampolskiy
(Summary by Karl von Wendt and Remmelt Ellen)
This is a summary of the paper “On the Controllability of Artificial Intelligence: An Analysis of Limitations”, which shows that advanced artificial general intelligence (AGI) with the ability to self-improve cannot be controlled by humans. Where possible, we have used the original wording of the paper, although not necessarily in the same order. For clarity, we have replaced the term AI in the original paper with “AGI” wherever it is referring to general or superintelligent AI. Literature sources and extensive quotes from previous work are given in the original paper.
The invention of artificial general intelligence is predicted to cause a shift in the trajectory of... (read 2503 more words →)