x

LESSWRONG

LW

mkenney — LessWrong

mkenney

mkenney

Message

Senior Engineer at Amazon, where I build physics-informed ML models and agentic AI tools for battery data analysis and interpretation. PhD in Chemistry from Stanford, with publications in Science and PNAS. My interpretability research applies quantitative techniques from the natural sciences to mechanistic interpretability. Blog:...

1

4mo

mkenney

Senior Engineer at Amazon, where I build physics-informed ML models and agentic AI tools for battery data analysis and interpretation. PhD in Chemistry from Stanford, with publications in Science and PNAS. My interpretability research applies quantitative techniques from the natural sciences to mechanistic interpretability. Blog:...

Applying Network Motif Analysis to Transformer Attribution Graphs

TL;DR: Analyzing attribution graphs manually is tedious and doesn't scale. To help automate some of this process, I ported network motif analysis (the technique Uri Alon used to decode gene regulatory networks) into a tool for automatically fingerprinting the structural properties of transformer circuits. I ran it on 99 attribution...