This is a special post for quick takes by Richard_Ngo. Only they can create top-level comments. Comments here also appear on the Quick Takes page and All Posts page.
I previously noted that we’re seeing a pretty sharp divergence between the measured capabilities of models and their real-world impacts, which should suggest that something weird is going on.
There's something there but I think its scary to reason from the the lack of normal economic impacts because they're such a lagging indicator.
I think the current situation is:
Frontier AI labs are really getting to the point where the nature of their work is fundamentally changed and productivity really is up by a large fraction (cf recent Ant, OAI acceleration posts)
In most other places the impact is pretty modest
AI labs are willing to spend hundreds of thousands of dollars per member of staff on compute to boost productivity
AI labs have a combination of beliefs and competitive pressures (including deep throughout the company) that allow them to aggressively redesign workflows around new tools
A large amount of the training effort of labs goes into the kinds of work done by these companies, not least just because the feedback loop from the massive usage volume is so tight
Pretty much no other workplaces have this combination (maybe like Jane Street/Citadel? would be very curious to hear how much AI is accelerating them)
I think this means that it makes a lot of sense that we could see limited global economic transformation but AIs really are capable of speeding up the labs by a huge and increasing factor, and potentially going FOOM. By Christmas per Alex's above post still seems aggressive but it seems more likely than after 2030 (conditioned on no slowdown).