TL;DR: Prompted roleplay personas retain an Assistant-associated core while differentiating from it across model layers and gaining their own behavioral and stylistic features. Story characters appear to not have that core. We also identify “Immersive Simulation” features which separate the default Assistant from roleplay and story generation. When the user...
The full paper is available at "Many Are My Names": The Anatomy of the Assistant and Its Personas via Sparse Autoencoders When a post-trained model generates text, it does so from the point of view of a certain speaker – the identity currently producing a response. Usually, that speaker is...
The full paper is available at "Many Are My Names": The Anatomy of the Assistant and Its Personas via Sparse Autoencoders When a post-trained model generates text, it does so from the point of view of a certain speaker – the identity currently producing a response. Usually, that speaker is...
The full paper is available at "Many Are My Names": The Anatomy of the Assistant and Its Personas via Sparse Autoencoders When a post-trained model produces text, it does so from the point of view of a certain speaker, unless prompted otherwise. Usually, that speaker is the default Assistant. But...
The full paper is available at "Many Are My Names": The Anatomy of the Assistant and Its Personas via Sparse Autoencoders When a post-trained model produces text, it does so from the point of view of a certain speaker, unless prompted otherwise. Usually, that speaker is the default Assistant. But...