Some thoughts on David Roodman’s GWP model and its relation to AI timelines

12Daniel Kokotajlo

New Comment

1 comment, sorted by Click to highlight new comments since: Today at 6:12 AM

Nice post! I basically agree with you here. Trying to forecast AI using GDP data is like trying to forecast fossil fuel production by looking at global mean temperature data. But it's useful for rebutting people who think that transformative AI, AGI, etc. is crazy/unprecedented/low-prior.

Nitpick: I don't think it's helpful to describe some of the arguments as "inside view" and others as "outside view" here. This can mislead people into thinking that e.g. the arguments you label "outside view" should be treated differently from those you label "inside view," that e.g. people who aren't experts should put more weight on the "outside view" arguments, etc., and that this is justified by Tetlock's experiments and the surrounding literature.

Whereas in fact Tetlock's experiments etc. were about a different sort of thing than the kinds of arguments you are considering here. Besides, the terms "inside view" and "outside view" mean so many different things today that they basically just tell the audience how you feel about an argument and how you want the audience to feel about it. Taboo outside view! I would suggest you replace instances of "inside-viewy" with "model-based" or "technical," or "implausible assumptions" and replace instances of "outside-viewy" with "Sanity check" or "implausible predictions."

[Cross posted from the EA forum.]

I’ve been working on a report (see blog) assessing possible trajectories for GWP out to 2100. A lot of my early work focussed on analysing a paper of my colleague David Roodman. Roodman fits a growth model to long-run GWP; the model predicts a 50% probability that annual GWP growth is >= 30% by 2043.

I was thinking about whether to trust this model’s GWP forecasts, compared with the standard extrapolations that predict GWP growth of ~3% per year or less.

^{[1]}I was also thinking about how the model might relate to AI timelines.This post briefly describes some of my key takeaways, as they don’t figure prominently in the report. I explain them briefly and directly, rather than focussing on nuance or caveats.

^{[2]}I expect it to be useful mostly for people who already have a rough sense for how Roodman’s model works. Many points here have already been made elsewhere.Although for brevity I sometimes refer to “Roodman’s extrapolations”, what I really mean is the extrapolations of his univariate model once it’s been fitted to long-run GWP data. Of course, David does not literally believe these extrapolations. More generally, this post is not about David’s beliefs at all but rather about possible uses and interpretations of his model.

[Views are my own, not my employers]

## Economic theory doesn’t straightforwardly support Roodman’s extrapolation over standard extrapolations

Early on in the project, I had the following rough picture in my mind (oversimplifying for readability):

I no longer see things this way. My attitude is more like (again oversimplifying for readability):

## Roodman’s GWP extrapolation is aggressive from an outside-view perspective

The above section gives an inside-viewy reason to think Roodman’s GWP projections are aggressive. (The model assumes population is output-bottlenecked; when you remove this assumption you predict slower growth.)

I think they’re also aggressive from an outside-view perspective, based purely on recent GWP growth data.

First, the model over-predicts GWP growth over the last 60 years and over-predicts frontier GDP/capita growth over the last 120 years. (This is widely recognised, and is documented in Roodman’s original post.)

Second, its median prediction for growth in 2020 is 7%. This is after updating on the GWP data until 2019. Why is this? Roodman’s model bases its prediction on the absolute

levelof GWP, and doesn’t explicitly take into account the recent growth rate. Roughly speaking, it believes that "higher GWP means higher growth" based on the pre-1900 data and it observes ~3% growth in the 1900s. GWP in 2020 is way higher than the average GWP in the 1900s, so the model predicts a higher value for 2020 growth than it observed throughout the 1900s.^{[7]}Why does it matter that the model predicts 7% growth in 2020? Well, GDP growth in frontier economies has recently been more like 2% (source). That’s a difference of 1.8 doublings.

^{[8]}Another 1.8 doublings gets us to 24% growth.^{[9]}In log-space, Roodman’s model thinks that we’vealreadycovered half the distance between 2% and 24%.^{[10]}To put it another way, Roodman’s model falsely thinks we’ve already covered ~half the distance to TAI-growth in log-space.

If in fact we have to travel twice as far through log-space, it will take

morethan twice as long according to hyperbolic-y models like Roodman’s. That’s because each doubling of growth is predicted to take less long than the last. Roodman’s model thinks we’ve already covered the slowest doublings (from 2% to 4%, 4% to 7%). In its mind, all we have left are the much-quicker doublings from 7 to 14% and 14% to 24%.How would adjusting for this change the GWP projections? Roughly speaking, it should

much more than doublethe time until 24% growth. Double it because growth has to double twice as many times. Much more than double it because the doublings Roodman’s model omitted will take much longer than the ones it included.I modelled this a bit more carefully, focussing on the time until we have 30% growth. Roodman’s model’s median prediction for the first year of 30% growth is 2043 -

~20 years away. I tried to adjust the model in two hacky ways, each time forcing it to predict that the growth in 2020 was 2%.^{[11]}I found the median prediction for 30% growth shifts back to ~2110 or later -~90 years away.^{[12]}The time to 30% much more than doubles.(The average GWP growth over the last 20 years is ~3.5%. If I set the 2020 growth to 3.5% rather than 2%, the predicted date of explosive growth is delayed to ~2075,

~55 years away.)In other words, if we adjust Roodman’s model based on what we know to be the

currentgrowth rate, its predictions become much more conservative.To be clear, I’m not saying that these adjustments make the model ‘better’. For example, they may

overadjustif the recent period is surprisingly slow.^{[13]}But I do think my adjustments are informative when considering what to actually believe from an outside-view perspective about future growth, especially in the next few decades. From an outside view perspective, I’d personally put more weight on the adjusted models than on Roodman’s original model.(Note: there may be inside view-y reasons to think an AI-driven growth acceleration will be sooner and more sudden faster than Roodman’s model suggests; I’m putting these aside here.)

## Roodman’s GWP extrapolation shouldn’t be given much weight in our AI timelines

Roodman’s model can predict how long it will take to get to a 30% annual GWP growth. Some people have thought about using this to inform timelines for transformative artificial intelligence (TAI). This rough idea is “we have pretty good outside-view reasons to think 30% growth is coming soon; TAI is the only plausible mechanism; so we should expect TAI soon”.

I don’t think this reasoning is reliable, for a few reasons (some discussed above):

untilwe have advanced AI (or population is output-bottlenecked for another reason). So it can’t predictwhenadvanced AI will happen.In my mind, population being output-bottlenecked is (part of) the

mechanismfor super-exponential growth. Roodman’s model describes how powerful this mechanism has been over human history: how quickly has it led growth to increase.^{[14]}The mechanism no longer applies, due to the demographic transition. However, advanced AI could reinstate the mechanism in a new form. So forecasting advanced AI is like forecasting when this mechanism will be in place again. But Roodman’s model forecasts growth on the assumption that the mechanismalreadyapplies; it can’t (reliably!) forecast when the mechanism will start to apply again.Roodman’s model is fit to long-run GWP data. The dynamics increasing growth in this period are

more people -> more ideas -> more peopleand a probably bunch of significant one-off changes in institutions around the industrial revolution.^{[15]}With AI the dynamics of increasing growth are

more AIs -> more ideas -> more hardware/software/wealth -> more and cleverer AIs ->...There’s a suggestive surface similarity there, suggesting that if the former leads to super-exponential growth the latter might as well.

But the actual processes will look pretty different which could introduce huge differences in growth.

Overall I think Roodman’s model is useful for indicating that something big could happen, that growth could dramatically accelerate, but otherwise not very informative. To the extent Roodman’s model is informative about AI timelines, I view it as aggressive for the reasons given in the bullets.

E.g. see here or links from the report. ↩︎

Read the report for nuance and caveats! ↩︎

In semi-endogenous growth models technology improves as the result of R&D effort but there are diminishing returns -- each 1% increase in technology (measured as TFP) requires more researcher-year than the last -- so that you need exponential growth in researchers to sustain exponential technology growth. The justification of exponential growth is then roughly: the number of researchers has grown roughly exponentially, so we’d expect technology to have grown roughly exponentially as well. ↩︎

This assumption is made explicit in Roodman’s multivariate model. The univariate model doesn’t feature population, so is naturally understood as a purely statistical model without interpretation. However, in Roodman’s paper the univariate model is motivated theoretically as the univariate analogue of the multivariate model (in which population is output-bottlenecked). This is why I say that the univariate model “assumes population is ‘output-bottlenecked’”. Technically, you can get hyperbolic growth from the multivariate model even if population is held constant and so it is not literally true that the univariate model assumes population is output-bottlenecked. However, more extreme parameter values are needed for this to happen, and such values are in tension with the non-hyperbolic growth of the last 100 years. So in practice, if not technically, I do think of Roodman’s univariate model as assuming that population is output-bottlenecked. ↩︎

Here I’m putting aside reasonable doubts over whether their explanation of pre-1900 growth is correct. ↩︎

When combined with the standard assumption that global population will stabilize, semi-endogenous models imply economic growth will gradually slow down over time. They don’t imply constant exponential growth long into the future. ↩︎

I’ve oversimplified my description of the data to simplify this paragraph. In reality GWP growth increased until ~1960 and got as high as 5%, even though frontier growth stopped increasing from 1900. ↩︎

2 * 2^(1.8) = 7 ↩︎

7 * 2^(1.8) = 24 ↩︎

Why think about it in terms of log-space? Roodman’s model (ignoring the randomness) believes that “each time GWP increases by a factor

f, GWP growth doubles”fdepends on the data, and comes out at about 3.5 for Roodman’s data set. So in Roodman’s model, considering doublings of growth, i.e. log-space, is natural: growth doubles each time GWP increases by 3.5X. This is true of other hyperbolic models as well, e.g. Kremer (1993). ↩︎Perhaps I should have set it to 2%, but I was using the recent GWP growth rate of 3.5%. ↩︎

The first method is my ‘growth multiplier’ explained here. Its median predicted date of explosive growth ranged from **2120 - 2140 **depending on an arbitrary choice of timescale (

rin the model). See code here. The second method just reduces the instantaneous growth rate of Roodman’s model at every time-step by a constant factor 2/7 (because it currently predicts 7% rather than 2%). This led to a median prediction of2110. See code here. ↩︎I also think Roodman’s unadjusted model is more informative about how fast we

couldgrow if the population were as large as our economy could support (Malthusian conditions). ↩︎Of course, Roodman’s parameters will also implicitly include other mechanisms influencing growth like the massive increase in the share of labour focussed on innovation, improvements in education, and other things. ↩︎

E.g. expansion of R&D as a share of the economy and better institutions for investing in new businesses. ↩︎