Farrel Mahaztra

Summary * Current reward hacking model organisms are poor proxies for real models. They do not exploit the hacks that open-weight frontier models do, and mostly hack narrowly or not at all. * This is based on our evaluation of three model organisms: Mini HackGPT (GPT-OSS-120B from Golechha et al.,...

This was the project I worked on during BlueDot Impact's AI Safety Fundamentals Alignment course, which expands on findings from Meinke et al's "Frontier Models are Capable of In-context Scheming". Summary * A dataset of 1,011 variations of the sandbagging prompt ("consequences") from Meinke et al were generated using Claude...