From Oragnized Shelves to Layered Catalogs: Architectural Explorations for Sparse Autoencoders -- Crosscoders & Ladder SAEs Towards Hierarchical Data Structure
eby Yuxiao Li, Maxim Panteleev, Eslam Zaher, Zachary Baker, Maxim Finenko July 2025 | SPAR Spring '25 A post in our series "Feature Geometry & Structured Priors in Sparse Autoencoders" > TL;DR: We investigate how to impose and exploit structures across depths and widths in LLM internal representations. Building on...