Current Reward Hacking Model Organisms Don’t Hack Like Real Models
Summary * Current reward hacking model organisms are poor proxies for real models. They do not exploit the hacks that open-weight frontier models do, and mostly hack narrowly or not at all. * This is based on our evaluation of three model organisms: Mini HackGPT (GPT-OSS-120B from Golechha et al.,...
Nov 87