This is a special post for quick takes by evhub. Only they can create top-level comments. Comments here also appear on the Quick Takes page and All Posts page.
I think this is suggestive that we should be reorienting a lot of model auditing and evaluation work to prepare for a world where we no longer have reliable alignment auditing evidence on production models.
As I understand it, the case for model organisms work being useful rests on their misaligned behavior being similar enough to that of frontier systems that solutions generalize. But it seems like the case you’re making here rests instead on model organisms lacking the very kinds of misaligned behavior which this sort of work aims to investigate (e.g. evaluation awareness and increased complexity of alignment failure modes).
So I don’t expect the solutions validated with these model organisms to generalize; worse, I expect them to generalize increasingly less well the more AI companies scale, and the dissimilarity between model organisms and frontier systems grows wider. Which suggests this research will predictably become less useful the more it’s needed.