This is a special post for quick takes by anaguma. Only they can create top-level comments. Comments here also appear on the Quick Takes page and All Posts page.
The recent Deepseek paper used LogitLens and CKA to analyze their new Engram architecture. This is the first time I've seen interpretability research be used in a capabilities paper, and I wonder if this trend will continue as the field of interpretability advances.