LESSWRONG
LW

2873
shen yue
0010
Message
Dialogue
Subscribe

Posts

Sorted by New

Wikitag Contributions

Comments

Sorted by
Newest
No posts to display.
No wikitag contributions to display.
Induction heads - illustrated
shen yue2y10

Thanks for your hard work. I wonder why in the layer 0 attention head, the positions of the query and value are 1?

Reply