LESSWRONGTags
LW

Transformer Circuits

EditHistorySubscribe

Help improve this page

EditHistorySubscribe

Help improve this page

Transformer Circuits

Contributors

Posts tagged Transformer Circuits

Most Relevant

2

90200 Concrete Open Problems in Mechanistic Interpretability: IntroductionΩ

3mo

0

2

31200 COP in MI: Interpreting Algorithmic ProblemsΩ

3mo

1

2

29A Walkthrough of Interpretability in the Wild (w/ authors Kevin Wang, Arthur Conmy & Alexandre Variengien)Ω

5mo

15

2

20A Walkthrough of In-Context Learning and Induction Heads (w/ Charles Frye) Part 1 of 2Ω

4mo

0

2

17200 COP in MI: Exploring Polysemanticity and SuperpositionΩ

3mo

0

2

17200 COP in MI: Analysing Training DynamicsΩ

3mo

0

2

16Understanding the tensor product formulation in Transformer Circuits

1y

2

2

15200 COP in MI: Looking for Circuits in the WildΩ

3mo

5

2

12200 COP in MI: Techniques, Tooling and AutomationΩ

3mo

0

1

22No Really, Attention is ALL You Need - Attention can do feedforward networks

2mo

2

1

15Anthropic's SoLU (Softmax Linear Unit)

9mo

1

1

8Addendum: More Efficient FFNs via Attention

2mo

0