tl;dr: The Persona Selection Model asks “if we learned that a person responded to x with y, what sort of a person would we think they are?” I argue that this question is based on a flawed understanding of language, as belied by the authors’ inconsistent attempts to apply their...
tl;dr: The Persona Selection Model ("PSM") argues that AI assistants behave like humans because (1) they learn to simulate different personas during pre-training and (2) post-training shapes which of these human-like personas they draw on. I think this is a useful mental model, but I disagree with the conclusion that...
Claude Is Odd: The Limits of the Persona Selection Model TL;DR: The claim at the heart of the Persona Selection Model (PSM) is that character representations shift next-token probabilities. In this piece, I argue that the structural linguistics of Russian-American linguist Roman Jakobson provides a better basis for understanding next-token...