The Geometry of Self-Other Distinction in Language Models Summary We seek to understand AI - and meanwhile, AI is building an understanding of us. It is well established that language models can construct surprisingly holistic user profiles (demograhpics, psychological traits) from relatively brief interactions. LLMs are trained on vast corpora...
Should you read this post? What if LLM hallucination isn't just a random error, but a result of two or more competing processes within the model? I started with studying "how LLM perceives its human users", however, my experiment results revealed a surprising implication on LLM hallucination. And the surprise...
Note: This post presents my research project from the MATS winter 2026 application process. It was submitted to Neel Nanda's mechanistic interpretability stream, and while I was not accepted due to the high competition, he described the work as 'particularly strong' and encouraged me to publish it. This content is...
Hello!! Just going to get this started, I'll implement a hybrid RAG (self-RAG + sparse RAG), and will post my weekly update here! The github repo is: https://github.com/violazhong/self-reflective-sparse-rag Thank you!!