TL;DR We are excited to announce the fourth iteration of ARENA (Alignment Research Engineer Accelerator), a 4-5 week ML bootcamp with a focus on AI safety! ARENA’s mission is to provide talented individuals with the skills, tools, and environment necessary for upskilling in ML engineering, for the purpose of contributing...
[heavily edited March 2025 to improve accuracy and reading style.] Abstract This paper examines a critical distinction in AI alignment approaches: static alignment, where AI models maintain fixed goals from their training period, vs dynamic alignment, where models continuously update to match current human preferences. I argue that dynamic alignment,...
We are excited to announce the fourth iteration of ARENA (Alignment Research Engineer Accelerator), a 4-5 week ML bootcamp with a focus on AI safety! ARENA’s mission is to provide talented individuals with the skills, tools, and environment necessary for upskilling in ML engineering, for the purpose of contributing directly to AI alignment in technical roles. ARENA will be running in-person from LISA from 2nd September - 4th October (the first week is an optional review of the fundamentals of neural networks).
Apply here before 23:59 July 20th anywhere on Earth!
ARENA has been successfully run three times, with alumni going on to become MATS scholars and LASR participants; AI safety engineers at Apollo Research, Anthropic, METR, and OpenAI; and... (read 1502 more words →)
[heavily edited March 2025 to improve accuracy and reading style.]
This paper examines a critical distinction in AI alignment approaches: static alignment, where AI models maintain fixed goals from their training period, vs dynamic alignment, where models continuously update to match current human preferences. I argue that dynamic alignment, which allows AI systems to adapt to evolving human values, presents significant advantages over static alignment despite still facing many challenges. The analysis focuses on three key areas: the impact of particular alignment styles on model behaviour, the implications for human autonomy and the privacy concerns inherent in preference monitoring. By examining how these models interact with human agency and value development, I demonstrate... (read 3572 more words →)