Introduction Greatly Transformative AI (TAI) will plausibly be created this decade. The U.S. is openly racing for AI dominance, rapidly expanding military use and explicitly evaluating frontier-model national-security risks—including cyber and CBRN capabilities. Investors and firms are pricing in large-scale deployment, while frontier labs are predicting substantial labor market disruptions....
This post consists of the Executive Summary and Conclusion of our proposal for model registries as a foundational tool for AI governance, authored by Elliot McKernon, Gwyn Glasser, Deric Cheng, and Gillian Hadfield. The full report is available through the link above. Executive Summary of Our Proposal In this report,...
Greatly Transformative AI (TAI) will plausibly be created this decade. The U.S. is openly racing for AI dominance, rapidly expanding military use and explicitly evaluating frontier-model national-security risks—including cyber and CBRN capabilities. Investors and firms are pricing in large-scale deployment, while frontier labs are predicting substantial labor market disruptions. Taken together, the stakes are high across cybersecurity, biosecurity, scientific R&D, labor markets, and military systems, and governments, militaries, major companies, and AI labs are acting accordingly.
Governments and researchers need a clear, coherent overview of urgent actions to prioritise and how they relate to each other, with contingencies given success or failure of important projects with uncertain outcomes. For example, how should success or failure in... (read 1988 more words →)
This post consists of the Executive Summary and Conclusion of our proposal for model registries as a foundational tool for AI governance, authored by Elliot McKernon, Gwyn Glasser, Deric Cheng, and Gillian Hadfield. The full report is available through the link above.
In this report, we propose that national governments should implement AI model registries as a foundational tool for AI governance. By model registry, we mean a centralized database of frontier AI models that includes standard commercial and specific safety-relevant information about these models and their deployers. Developers would be required to report any qualifying models and their information to the registry before public deployment.
In Parts I, II, and III, we explore and... (read 1130 more words →)
Thanks for all this!
On international cooperation: I'm not sure exactly what kinds of principles you're thinking of - my first thoughts go to the UN Governing AI For Humanity Principles. If it's something like that, I'd say that they are outside the scope of the proposal above for now. However, the Standard as imagined here does aim to meaningfully support international cooperation, despite appealing to things that countries should do out of self interest:
(i) The Standard itself works as a high-level strategy for an international governance organisation. For example, an international governing body could suggest or prescribe some minimal objectives across the 3 goals or 9 subgoals for nations to achieve by... (read more)