x

LESSWRONG

LW

astle dsa — LessWrong

astle dsa

astle dsa

Message

1

2

1y

astle dsa

1

1y

Tree Transformers: A step towards generalizing the transformer architecture

After a billion architectures and a trillion variations, I finally found a transformer architecture that intrigued me. And this essay is step one towards the theory and the sub-field on which it was built [1]. I. The representation of any dataset that we wish to approximate/predict/learn the distribution of, has...

Agentic Frameworks: Or different ways to make LLM API calls

The agentic framework research has produced some very interesting results; from different topologies to different ways of using tool-calls, it has been one of the most fascinating and accessible areas of research in the AI landscape. In this essay, I’d like to talk about some core structures that sit at...