luxia

> I ran a set of experiments to test whether transformer internal states carry a structured signal about how something is processed; one that's independent of what is processed. Three iterations of progressively harder controls on Llama 3.2 3B, and the signal held: concentrated in attention routing and KV cache...