dwmd

My first post explored "self-talk" induction in small base LLMs. After further contemplation, I decided that first I ought to better understand how LLMs represent "self" mechanistically before examining induced "self-talk". How do language models process questions about themselves? I've started by analyzing attention entropy patterns[1] across self-referent prompts ('Who...

Note: This is my first LessWrong post. I’m sharing initial observations of a small empirical study on open-source LLM behavior. These observations concern linguistic dynamics rather than literal agency, and I welcome replication, critique, and other pointers around this kind of research. These are empirical notes on basal language dynamics,...