How Fast is Algorithmic Progress in AI Inference?
by Hans Gundlach, Jayson Lynch, Matthias Mertens, Neil Thompson (All researchers are part of MIT Futuretech) Epistemic Status: This is a work in progress, and we would appreciate criticism as well as suggestions in all aspects of this work. TLDR: We estimate that general inference efficiency increases 3-10x per year....
Jul 13, 202516