I think "recursive self-improvement" is load-bearing ambiguous in AI risk discourse. In conversations, it refers to at least three qualitatively different processes that share a family resemblance but differ in basically every practically relevant dimension: mechanism, speed, observability, bottlenecks, governance implications, timeline relevance.

Treating them as one thing produces confused models and bad intuitions. So I want to pull them apart explicitly.

Type 1: Scaffolding-Level Improvement

This is the one that's already happening and empirically observable with coding agents.

The mechanism: better orchestration → better task decomposition → better use of existing cognition → emergent competence gains. You wrap the same base model in better scaffolding and suddenly it can do things it couldn't do before. No algorithmic breakthrough required.

This is recursive improvement of systems, not of minds. But it may be the case that systems self-improvement can still kill worlds. Or, at least, systems improvement can still cause massive harm, enable misuse, and produce dangerous autonomous agents earlier than expected.

I think a lot of immediate AI risk comes from this layer. You don't need foom to get powerful autonomous systems doing economically or politically significant things with minimal human oversight. And as we see now, they won't even need to escape as the access is granted freely.

The bottlenecks here are mostly engineering and integration, not fundamental capability limits. Which means progress can be fast, cheap, and somewhat unpredictable.

Type 2: R&D-Level Improvement

This is the dominant notion in formal takeoff models and big-picture forecasting (the AI-2027-style analyses). It's about AI compressing the AI research cycle.

Mechanism: AI helps design architectures, tune hyperparameters, discover training tricks, automate experiments. Human researchers become more productive. Research cycles that took months take weeks. The production function for intelligence gets a multiplier.

This is recursive improvement of the process that produces intelligence, which is not the same as intelligence modifying itself. The distinction matters because the bottlenecks are different. R&D-level improvement is constrained by:

Compute availability
Data
Ideas (which may not be parallelizable)
Organizational overhead
Testing and validation time

It's slower than sc...

SOMNIAC EFFECTS

SOMNIAC EFFECTS