Justin Olive

This is an update on what we’re doing at Generality Labs, and a quick introduction for those who aren’t familiar with our work Written by Justin Olive, co-founder & CEO Tl;dr I started Generality Labs because, when the time comes, I don’t think we’re going to be able to accurately measure the safety of dangerously capable AI systems. We're focused on AI evaluation, and our goal is to ensure that the best available tools and practices are adopted at the places where it matters most - AI safety labs, governments, 3rd party evaluators, frontier AI labs. We have 2 work streams: Services: * Independent evaluation audits: we provide 3rd party audits for evaluation developers who want to catch flaws in their evals, and build trust with stakeholders through independent quality assurance * Advising: we provide expert input into internal processes and standards relating to AI evaluation * Research services: our forward deployed scientists & engineers help organisations run experiments that use our tools and infrastructure Tools/infra: * Inspect Evals: our platform for sharing and running evals * Inspect Auditor: runs experiments to stress-test an eval, and compiles findings into an audit report Here's how I see the next 1-2 years playing out: * Our research and tooling will help expose and quantify substantial gaps in the evaluation ecosystem * This will motivate development and adoption of better tools and practices (which we're also developing) * The result will be that risk assessments and AI safety research are much more accurate, helping us avoid incidents through interventions like deployment pacing and better alignment training methods We're hiring! * Senior Product Engineer (Inspect Evals) * Applied Research Scientist Who are we? * Generality Labs is an AI safety lab based in London * We were founded in July 2026, spinning off from Arcadia Impact with $4.4M in seed funding from Coefficient Giving * Prior to spinning off, we delivered >$