designer-coderajay

I've been building a mechanistic interpretability toolkit for the last few months. Not writing about it — actually building it, running into walls, rewriting things. This post is about two implementation problems that cost me real time, and a metric I had to invent because I couldn't find what I...

Cross-posted to the Alignment Forum. I've spent the past few months building Glassbox — a mechanistic interpretability toolkit that does automated circuit discovery in ~1.2 seconds on GPT-2 small. I want to share the technical choices, a novel metric I developed, and some honest caveats about what the tool does...