Ameya Panchal

Confident in the measurements — copying score, OV logits, attention patterns. More exploratory on the interpretations of what the head "knows," two of which I ended up disconfirming myself. My first mechanistic interpretability post; corrections welcome. Full analysis and code: github/Ameya-bit/QuotesByNiche I trained a small character level transformer on Nietzsche...