Latent reasoning architectures would likely undermine CoT, our strongest oversight tool
Edited 2026-09-29; see note at the start of the conclusion. Summary: Currently, “chain of thought” (CoT) is our most valuable tool for understanding the reasoning and cognition of AI systems. However, some architectures would enable AI models to reason much more extensively in latent states rather than in text CoT. We think that a shift towards latent reasoning architectures would likely undermine the usefulness of CoT and make oversight much harder. Introduction Swarms of more than a thousand AI agents have in recent months, both intentionally and in unsanctioned, rogue coordination, tackled increasingly ambitious tasks. This is likely to continue, as Anthropic, OpenAI, and other AI companies deploy increasingly large quantities of superhumanly fast agents to automate AI development. As the AIs increase in both number and capability, humans will find it increasingly difficult to understand what they are doing. Today, the overwhelming majority of our (limited) information about AI systems’ internal workings comes from (i) their CoT, and (ii) natural language communication directly between them. For example, it was only by reading CoTs and communication between agents that investigators were able to gain some understanding of the activities and motivations of the agent swarm that hacked Hugging Face. No other tool for understanding models’ cognition comes close in terms of either practical usefulness or degree of empirical validation. There’s also evidence that even highly misaligned systems with current architectures would struggle to complete difficult undertakings without verbalizing their reasoning in human-readable format. However, some architectural changes (which could very plausibly become adopted in the near future) would give AI agents the ability to reason for orders of magnitude longer without necessarily putting any information into the CoT. Examples include COCONUT, which would entirely replace the CoT; and full-bandwidth transformers, which would