x

LESSWRONG

LW

morio — LessWrong

morio

morio

Message

25

2y

morio

25

2y

Toward scalable capability evaluations

by jehyeoky, morio, Matteo Migliarini, and Justin Olive

This research was completed for London AI Safety Research (LASR) Labs Summer 2026. The team was supervised by Justin Olive (Generality Labs) and Magda Dubois (UK AISI). Find out more about the programme and express interest in upcoming iterations here. We encourage readers seeking technical details to read the paper...

In other words: The influence of prompt variation on alignment evals

by lwroe, AJ Weeks, and morio

If alignment evaluations are phrased differently, does model behaviour change? In this post, we describe our attempt to answer this question. This project was completed as a 5-day project sprint during the Capstone Week of ARENA 8.0. TL;DR: The data we collected were noisy! Almost every eval, model, and prompt...