dl

Summary of this post This is the second in a series of posts detailing my manifold findings while investigating how a chess transformer engine that mimics human play represents knight forks. Last post described strong correlational evidence that the knight-fork policy logit snaps into place after block 5’s attention layer....

I was poking around at a chessformer which mimics human play and made this fun companion app to visualize a lot of the internals of the engine. Check out how attention heads look, how the residual stream evolves, and play around with it if interested!

(parts 2 and 3 to follow) Summary of this post This post is on the results of a mechanistic interpretability project aimed at understanding the internals of Maia 3: a transformer based chess bot trained to imitate human play at a chosen skill level, rather than to play optimally. My...