Tom DAVID

I am sharing this call from the EU AI Office for organizations involved in evaluation. Please take a close look: among the selection criteria, organizations must be based in Europe, or their leader must be European. If these criteria pose challenges for some of you, feel free to reach out to me at tom@prism-eval.ai. We can explore potential ways to collaborate through PRISM Eval. I believe it’s crucial that we support one another on these complex and impactful issues. The AI office is collecting contributions from experts to feed into the workshop on general-purpose AI models and systemic risks. The European AI Office is hosting an online workshop on 13 December 2024 (only for specialists), focusing on the evaluation of general-purpose AI models with systemic risk. This is an opportunity for organisations and research groups to showcase their expertise and contribute to shaping the evaluation ecosystem under the EU AI Act. The event will bring together leading evaluators and the AI Office to exchange insights on state-of-the-art evaluation methodologies for general-purpose AI models. Selected participants will present their approaches, share best practices, and discuss challenges in assessing systemic risks associated with advanced AI technologies. This initiative aims to foster collaboration and advance the science of general-purpose AI model evaluations, contributing to the development of robust frameworks for ensuring the safety and trustworthiness of these models. Call for submissions The AI Office invites evaluators to submit abstracts of previously published papers on the evaluation of general-purpose AI models with systemic risk. Key topics include: * CBRN Risks: Risks related to chemical, biological, radiological, and nuclear threats * Cyber Offense: Risks associated with offensive cyber capabilities * Major Accidents: Risks of large-scale disruptions or infrastructure interference * Loss of Control: Concerns about oversight and alignment of au