Symbol-Concept Dissociation in SAE Steering
This post is a case study of two models: gemma-4-e4b-it, which I fine-tuned, and gemma-2-2b-it, which I used as a rough cross-model check. I’m reasonably confident about the main result described below, namely the separation between features that appear to read symbolic control values and features that appear to participate...
Jul 311