Transformers

Applied to An interesting mathematical model of how LLMs work by Bill Benzon 10d ago

Applied to Transformers Represent Belief State Geometry in their Residual Stream by Adam Shai 24d ago

Applied to Barcoding LLM Training Data Subsets. Anyone trying this for interpretability? by right..enough? 1mo ago

Applied to Understanding mesa-optimization using toy models by tilmanr 1mo ago

Applied to Decompiling Tracr Transformers - An interpretability experiment by Hannes Thurnherr 1mo ago

Applied to Modern Transformers are AGI, and Human-Level by jacobjacob 1mo ago

Applied to Deconfusing In-Context Learning by Arjun Panickssery 2mo ago

Applied to Skepticism About DeepMind's "Grandmaster-Level" Chess Without Search by Arjun Panickssery 3mo ago

Applied to Attention SAEs Scale to GPT-2 Small by robertzk 3mo ago

Applied to Striking Implications for Learning Theory, Interpretability — and Safety? by RogerDearnaley 4mo ago

Applied to AGI will be made of heterogeneous components, Transformer and Selective SSM blocks will be among them by Roman Leventov 4mo ago

Applied to Exploring the Residual Stream of Transformers for Mechanistic Interpretability — Explained by Zeping Yu 5mo ago

Applied to Has anyone experimented with Dodrio, a tool for exploring transformer models through interactive visualization? by Bill Benzon 5mo ago

Applied to The Method of Loci: With some brief remarks, including transformers and evaluating AIs by Bill Benzon 5mo ago

Applied to New Tool: the Residual Stream Viewer by AdamYedidia 7mo ago

Applied to World, mind, and learnability: A note on the metaphysical structure of the cosmos [& LLMs] by Bill Benzon 8mo ago

Applied to Google DeepMind's RT-2 by SandXbox 9mo ago

Applied to The positional embedding matrix and previous-token heads: how do they actually work? by AdamYedidia 9mo ago

Applied to How LLMs are and are not myopic by janus 9mo ago

Applied to GPT-2's positional embedding matrix is a helix by AdamYedidia 10mo ago