This is a slightly modified version of Appendix E from our paper "Compute Trends Across Three Eras of Machine Learning". You can find the summary here and the complete paper here. After sharing our updated compute trends analysis a common question was: "So how are your findings different from OpenAI’s...
Metaculus has launched the AI Progress Essay Contest which aims to attract systematic thinkers to engage with the wealth of AI Forecasts that Metaculus has built up over the years. Of particular interest is rigorous and nuanced thinking about the likelihood, timing, and impacts of transformative AI that engages with...
by Jaime Sevilla, Lennart Heim, Marius Hobbhahn, Tamay Besiroglu, and Anson Ho You can find the complete article here. We provide a short summary below. In short: To estimate the compute used to train a Deep Learning model we can either: 1) directly count the number of operations needed or...