LESSWRONG
LW

1759
Wikitags

Comp-In-Sup

Edited by Linda Linsefors, et al. last updated 6th Oct 2025

Computation in Superposition (Comp-in-Sup) is a sub-field of Mechanistic Interpretability (Mech-Interp).

Superposition in this context means storing information in an overcompleet basis. Comp-in-Sup is the study of how (and if) neural networks performs computation, using information stored in overcomplete basis. The reason we want to do this, is because this information could inform better feature extraction methods.

Subscribe
Discussion
Subscribe
Discussion
Posts tagged Comp-In-Sup
212Toward A Mathematical Framework for Computation in Superposition
Ω
Dmitry Vaintrob, jake_mendel, Kaarel
2y
Ω
19
131Circuits in Superposition: Compressing many small neural networks into one
Ω
Lucius Bushnaq, jake_mendel
1y
Ω
9
73Circuits in Superposition 2: Now with Less Wrong Math
Ω
Linda Linsefors, Lucius Bushnaq
4mo
Ω
0
57Compressed Computation is (probably) not Computation in Superposition
Jai Bhagat, Sara Molas Medina, Giorgi Giglemiani, StefanHex
5mo
9
Add Posts