How Fast is Algorithmic Progress in AI Inference?
by Hans Gundlach, jaysonl, and mmertens
by Hans Gundlach, Jayson Lynch, Matthias Mertens, Neil Thompson (All researchers are part of MIT Futuretech) Epistemic Status: This is a work in progress, and we would appreciate criticism as well as suggestions in all aspects of this work. TLDR: We estimate that general inference efficiency increases 3-10x per year....
Jul 13, 202516