There are unlimited serial depth style changes one could make, I agree, but the article doesn't say it is.

Edit: I heard The Information say that it was based on the paper Scaling up Test-Time Compute with Latent Reasoning: A Recurrent Depth Approach, which allows information flow from late layers to earlier layers, and have a shared KV architecture, enabling arbitrarily large serial reasoning, which if true is a five-alarm fire, because this means that OpenAI's limit here on serial reasoning is likely temporary.

I want to figure out how to access the full contents of the Information article, since I want to know if the Information actually claimed this.

IMO, that's most of the problem, to my eyes.

I'm not too worried about Astra's looping today, I'm worried about the temptation to keep scaling/get rid of those limits as fast as possible when performance at real-world tasks and compute-efficiency is at stake, and in particular it's a bad sign of more neuralese/recurrent-like architectures starting to work at scale, meaning that the AI community can start improving on it.

(The main difficulty of making a useful AI technique in my model is trying to make it work on large, frontier models, and OpenAI's Scientist Head hasn't shown that we can't scale this up arbitrarily, rather than the current limit being an OpenAI setting of a dial, but where others will set it higher.)