henryc

TL;DR: We think allowing frontier AI models to be used for mass domestic surveillance and to operate as fully autonomous weapons creates significant risks of emergent misalignment. For those somehow unaware, the Department of War and Anthropic have had a recent dispute over the use of Claude, leading to Anthropic...

Overview I'm currently an ERA fellow researching ways to improve inoculation prompting as a technique against emergent misalignment. It's one of the few alignment techniques that works against EM, and I think it has potential to be generalised further. There's lots of experiments I won't have time to run, and...