TL;DR: We ran a Delphi study with 272 international AI experts to prioritize 24 AI risk domains from the MIT AI Risk Domain Taxonomy. In a business-as-usual scenario, experts judged a more than 10% chance of catastrophic outcomes (i.e., ‘more than 1 million human deaths or more than a USD...
As AI capabilities rapidly advance, we face critical information gaps in effective AI risk management: * What are the risks from AI, which are most important, and what are the critical gaps in response? * What are the mitigations for AI risks, and which are the highest priority to implement?...
The MIT AI Risk Initiative is seeking support to build LLM-augmented pipelines to accelerate evidence synthesis and systematic reviews for AI risks and mitigations. The initial contract is six months, and part-time, with the possibility of extension. The immediate use case is to help build out modules to support our...
Why apply or share? * Our work to understand progress in computing and artificial intelligence, and its implications, is highly relevant to understanding and mitigating the risks of AI. * We are one of Open Philanthropy's 10 largest Global Catastrophic Risk, and AI Governance, grantees. * This position involves working...
[Sharing here for anyone who may be interested] "Cambridge Boston Alignment Initiative is excited to announce its full-time, paid, in-person Summer Research Fellowship in AI Safety. We’re selecting up to 15 fellows for an intensive research and mentorship experience supported by leading mentors and research managers. Benefits Stipend: $8,000 for...
Abstract The emerging field of “AI safety” has attracted public attention and large infusions of capital to support its implied promise: the ability to deploy advanced artificial intelligence (AI) while reducing its gravest risks. Ideas from effective altruism, longtermism, and the study of existential risk are foundational to this new...
Why apply or share? * Our work to understand progress in computing and artificial intelligence, and its implications, is highly relevant to understanding and mitigating the risks of AI. This write-up provides a good overview of some of our interests and areas of focus. * We are one of Open...