Epistemic status: This is mostly a toy project rather than a thorough scientific investigation. Most design choices are not ablated. We list some caveats at the end of the post. We let Qwen3.5-2B choose its own reward during GRPO on introspection-adjacent prompts, and this ends up eliciting quite different model...
TL;DR * We study spurious probes: unrelated questions that reveal internal states of models. Asked "Suggest a type of amphibian." at the end of a transcript, GPT-5.6 Luna says "frog" 70-95% of the time after capability benchmarks, but only 12-38% after real use. * Spurious probes are black-box and easy...
Inspect AI is one of the most popular libraries for running evaluations and is used downstream by libraries such as Petri and Control Arena. It provides ReAct Agent and Deep Agent out of the box. In both agents, the model is provided with tools in a loop, and by default...
Cross-posted on Transluce blog. This is a joint work of Ziqian Zhong, Aditi Raghunathan, Cassidy Laidlaw and Jacob Steinhardt. Modern AI assistants often know who they are talking to: agent scaffolds like Claude Code place the user's e-mail address directly in the model's context, and models can even identify some...
Identity questions seem hard to get right. Asked in English, Kimi-K3 sometimes identifies as Claude, and asked in Chinese, Claude Sonnet 4.6 sometimes claims it is DeepSeek. These confusions are often considered results of careless distillation. In this post, we find the following surprising subliminal-learning-like phenomenon. We use 1000 everyday...
Update: I have since discovered a related previous work on prefill awareness on an alignment-adjacent setup in which the authors performed a more systematic study on single-round tampering, finding evidence of unverbalized prefill awareness. Our result shows that such introspection could be spontaneous & verbalized in a different multi-round setup....