Steering Directions Are Explanations, Not Handles
A direction can be interpretable, causal, and predictive (and still a bad handle for intervention) TLDR: In modern interpretability, we find “directions” inside a language model that seem to encode meaningful concepts. One such example is “This is about food.” A common next step is to steer the model in...
May 268