LESSWRONGTags
LW

Transformers

EditHistorySubscribe

Help improve this page

EditHistorySubscribe

Help improve this page

Contributors

Posts tagged Transformers

Most Relevant

2

86Google's PaLM-E: An Embodied Multimodal Language Model

20d

7

2

55Tracr: Compiled Transformers as a Laboratory for Interpretability | DeepMind Ω

2mo

12

2

53How fast can we perform a forward pass?

10mo

9

2

47Concrete Steps to Get Started in Transformer Mechanistic InterpretabilityΩ

3mo

7

2

23How Do Induction Heads Actually Work in Transformers With Finite Capacity?

4d

0

1

44Searching for Modularity in Large Language Models

NickyP, Stephen Fowler

7mo

3

1

42Building a transformer from scratch - AI safety up-skilling challengeΩ

Marius Hobbhahn

5mo

1

1

33Brief Notes on TransformersΩ

6mo

2

1

22No Really, Attention is ALL You Need - Attention can do feedforward networks

2mo

2

1

8Research agenda - Building a multi-modal chess-language model

1y

2

1

8Addendum: More Efficient FFNs via Attention

2mo

0

1

7Are Mixture-of-Experts Transformers More Interpretable Than Dense Transformers? Q

3mo

4

1

-4So, just why do GPTs have to operate by continuing an existing string?

3d

0