As AI capabilities rapidly advance, we face critical information gaps in effective AI risk management: * What are the risks from AI, which are most important, and what are the critical gaps in response? * What are the mitigations for AI risks, and which are the highest priority to implement?...
TL;DR: We ran a Delphi study with 272 international AI experts to prioritize 24 AI risk domains from the MIT AI Risk Domain Taxonomy. In a business-as-usual scenario, experts judged a more than 10% chance of catastrophic outcomes (i.e., ‘more than 1 million human deaths or more than a USD...
As AI capabilities rapidly advance, we face critical information gaps in effective AI risk management: * What are the risks from AI, which are most important, and what are the critical gaps in response? * What are the mitigations for AI risks, and which are the highest priority to implement?...
The MIT AI Risk Initiative is seeking support to build LLM-augmented pipelines to accelerate evidence synthesis and systematic reviews for AI risks and mitigations. The initial contract is six months, and part-time, with the possibility of extension. The immediate use case is to help build out modules to support our...
Why apply or share? * Our work to understand progress in computing and artificial intelligence, and its implications, is highly relevant to understanding and mitigating the risks of AI. * We are one of Open Philanthropy's 10 largest Global Catastrophic Risk, and AI Governance, grantees. * This position involves working...
[Sharing here for anyone who may be interested] "Cambridge Boston Alignment Initiative is excited to announce its full-time, paid, in-person Summer Research Fellowship in AI Safety. We’re selecting up to 15 fellows for an intensive research and mentorship experience supported by leading mentors and research managers. Benefits Stipend: $8,000 for...
Abstract The emerging field of “AI safety” has attracted public attention and large infusions of capital to support its implied promise: the ability to deploy advanced artificial intelligence (AI) while reducing its gravest risks. Ideas from effective altruism, longtermism, and the study of existential risk are foundational to this new...