This is a full repost of my Hidden Agent Substack post. LLM disclaimer: The post has been written with ChatGPT 5.2 assistance and some paragraphs may still show that even though I have written most of the post myself. The image is generated by NanoBanana. Adam Smith’s Invisible Hand is...
Companion to "The Hostile Telepaths Problem" (by Valentine) Epistemic status: This is my own work, though I asked Valentine for feedback on an early draft. I'm confident that the mechanisms underlying the Hostile/Friendly Telepath dynamic are closely related. The problems of the friendly telepath problems seem well-established. I am less...
Epistemic status: Confident in the direction, not confident in the numbers. I have spent a few hours looking into this. Suppose human values were internally coherent, high-dimensional, explicit, and decently stable under reflection. Would alignment be easier or harder? My below calculations show that it would be much harder, if...
Epistemic status: I’m using a single clinical case study as a running example to illustrate three empirical aspects of cognition that are well-documented but rarely used together. The point is not that this case study proves anything, but to build an intuition that I then connect to more systematic empirical...
finding agents in raw dynamics Related: Formalizing «Boundaries» with Markov blankets, «Boundaries» Sequence The Dataset Suppose you are given time series data from a simulated ecology (such as Smallville). You can usually tell what the agents in there are doing; at least if the variables are properly labeled. If they...
Integrating LLMs with Lean prover scaffolding. Summary provided by Xixidu: > Hermes introduces an architecture where a language model is wrapped around an external, high-reliability verifier: the Lean4 proof assistant. > > Instead of just asking the AI “Does this look right?”, it translates key mathematical steps into Lean4 code...
This tries to be a pretty comprehensive lists all AI safety, alignment, and control interventions. Much of the collection was conducted as part of an internal report on the field for AE Studio under Diogo de Lucena. I'd like to thank Aaron Scher, who maintains the #papers-running-list at the AI...