This is a special post for quick takes by Richard_Ngo. Only they can create top-level comments. Comments here also appear on the Quick Takes page and All Posts page.
I doubt Richard is proposing to ignore coding automation trends; I took him to be arguing that recent progress isn't necessarily on track to deliver on AGI in a few years. I'm also skeptical of confident short timelines, especially on the basis of these kinds of arguments. The relationship between "coding automation" and "AGI" seems tenuous to me in a way that people often brush past. E.g. people often talk about "coding automation" as one coherent thing, much like people talk about "horizon length" as one coherent thing. But these are massive clusters of tasks spanning all kinds of knowledge work, and the kind of knowledge work AI automates might matter a lot for how quickly RSI goes (or if it goes at all).
Also, I agree with Richard that the disconnect between measured ability and real-world impact is weird; I think this should count some against the usefulness/powerfulness of this paradigm, and the counter-arguments I've heard aren't very good. E.g. a popular one is that every automation step just moves us to a new bottleneck, such that despite models becoming more powerful we still might not end up seeing much increased output from the organization/economy overall. But this logic applies to every automation advance ever (e.g. mechanized weaving, farming, computers) and yet almost all such advances had pretty obvious, macroscopic effects, and were obviously on track to early on. Most of the time people just fall back on "the gods of straight lines" type arguments—i.e. that any setbacks we currently see are just going to resolve with scale—which I agree are suggestive, but are also really far from providing an argument that we should confidently expect this.