Applying the Jacobian lens to WeirdChat: cross-behavior refusal signatures in Qwen3.6-27B
Executive summary Modern chat models fine-tuned for safety refuse harmful requests through a mechanism that operates in the residual stream. Arditi et al. (2024) showed refusal is mediated by a single direction across model families. This work asks a complementary question. What does that direction decode to in vocabulary terms?...
Jul 250