How informing millions about extinction risk from superintelligent AI works OpenAI has spent “low hundreds of millions” to buy a podcast to “accelerate global conversations around AI”. AI companies have embedded themselves in traditional media through corporate deals, and are funding super PACs to the tune of hundreds of millions...
Two days ago, Anthropic researcher Jacob Coxon resigned, stating that AI companies are “racing straight to self-improving superintelligence and gambling with our lives” and that they believe it “could kill us all by the end of the decade”. At the same time, momentum is building to change course. These have...
Last week, the AI company Anthropic released a blog post titled “When AI builds itself”. This led to a media frenzy, with news outlets around the world publishing headlines that the company was urging a global pause on AI development, or calling for AI non-proliferation. However, the post does not...
ControlAI's mission is to avert the extinction risks posed by superintelligent AI. We believe that in order to do this, we must secure an international prohibition on its development. We're working to make this happen through what we believe is the most natural and promising approach: helping decision-makers in governments...
This post highlights a few key excerpts from our full impact report. You can read the full report at https://controlai.com/impact-report-2025. ControlAI is a non-profit organization working to avert the extinction risks posed by superintelligence. We help hundreds of thousands of people understand these risks and meet hundreds of lawmakers to...
In this paper, we make recommendations for how middle powers may band together through a binding international agreement and achieve the goal of preventing the development of ASI, without assuming initial cooperation by superpowers. You can read the paper here: asi-prevention.com In our previous work Modelling the Geopolitics of AI,...
We model how rapid AI development may reshape geopolitics in the absence of international coordination on preventing dangerous AI development. We focus on predicting which strategies would be pursued by superpowers and middle powers and which outcomes would result from them. You can read our paper here: ai-scenarios.com Attempts to...