Devin Shah

tl;dr > Models may adapt around the internal signals we use to understand and monitor them, making those signals less dependable after further training. I tested this by training a 4B model on a two-hop geography task while continuously suppressing its top-10 eligible J-lens directions at six middle layers. The...