The discourse about whether LLMs are the right paradigm for AGI is getting hung up on the wrong question. Scientists like Gary Marcus and Yann LeCun argue that pure scaling of today's models won't get to AGI. I think they're right. But so do all the frontier labs. Leaders at every frontier lab are on the record saying they expect we're 1-2 major architectural or algorithmic breakthroughs away. This is mainly a vibes war with people talking past each other.
So everyone agrees that we need more than pure scaling. The interesting question is: will the first AGI be directly descended from today's models, or will a radically new paradigm be needed?
I think the labs are correct that the first AGI will likely be something transformer-like plus a couple other things bolted on, as opposed to something in a whole different clade from the AI of 2026.
This implies that the research happening right now, including safety and alignment work, is likely building directly toward AGI. And that although regular AI safety will have important differences from AGI safety, progress on one can feed into the other.
Aeronautics offers an analogy. The two dominant early paradigms for high-altitude flight were lighter-than-air balloons and rockets. And as late as the 1930s, balloons had reached greater altitudes than rockets ever had.
Imagine someone back then had naively proposed that one day humans could fly to the moon by building an absolutely enormous hydrogen-filled dirigible—pure scaling. The correct answer would have been: "Sorry, buddy, you're barking up the wrong tree. The laws of physics don't allow that. It's just not a matter of how big the airship is."
Now imagine someone else back then proposing that we'll get to the moon with a single-stage rocket. He'd be just as wrong as the balloonist about whether his exact idea will reach lunar orbit. But we wouldn't say he was wasting his time. Many of the lessons learned by single-stage rocket pioneers during the '30s and '40s directly contributed to the multistage rockets that eventually got humans to the moon.
My expectation is that 2026 AI research isn't a balloon-style dead end, but more like single-stage rocketry on the way to the multistage rockets that will fly all the way to the moon of AGI.
Yeah, I'm referring here specifically to the liquid-fueled rocketry of the 1930s and 1940s that fed more directly into NASA-era rocketry. Some of the same people worked on both.