LESSWRONG
LW

311
Wikitags

Comp-In-Sup

Edited by Linda Linsefors, et al. last updated 6th Oct 2025

Computation in Superposition (Comp-in-Sup) is a sub-field of Mechanistic Interpretability (Mech-Interp).

Superposition in this context means storing information in an overcompleet basis. Comp-in-Sup is the study of how (and if) neural networks performs computation, using information stored in overcomplete basis. The reason we want to do this, is because this information could inform better feature extraction methods.

Subscribe
Discussion
Subscribe
Discussion
Posts tagged Comp-In-Sup
206Toward A Mathematical Framework for Computation in Superposition
Ω
Dmitry Vaintrob, jake_mendel, Kaarel
2y
Ω
19
131Circuits in Superposition: Compressing many small neural networks into one
Ω
Lucius Bushnaq, jake_mendel
1y
Ω
9
72Circuits in Superposition 2: Now with Less Wrong Math
Ω
Linda Linsefors, Lucius Bushnaq
3mo
Ω
0
56Compressed Computation is (probably) not Computation in Superposition
Jai Bhagat, Sara Molas Medina, Giorgi Giglemiani, StefanHex
4mo
9
Add Posts