Control questions matter: introspection, refusal ablation, and gates in open Gemma models
I am posting some highlights from my master's thesis I thought could be interesting to this audience. Summary * Introspection can be separated from model confusion but requires careful controls * Refusal direction ablation can increase model introspection performance, but looking at the logit differences on 'Yes'/'No' control questions shows...
Oct 177