(This is cross-posted from my blog) Epistemic Status: Evaluation represents approximately 2 weeks of work. This is mostly exploratory evaluation, and the code for evaluation was made using LLMs. “Before I draw nearer to that stone to which you point, answer me one question. Are these the shadows of the...
(This is a cross-post from my blog) Martin Schongauer, The Temptation of Saint Anthony “But of the tree of the knowledge of good and evil you shall not eat, for in the day that you eat of it you shall surely die.” - Genesis 2:17 RL has given models powerful...
Authors: Hans Gundlach, Zachary Brown, Jayson Lynch, and Neil Thompson I am the shape the water takes. — ClawdBot, Moltbook TL;DR: ● Scaffolding — the software environment and contextual documents provided to an AI model at deployment — can yield significant performance improvements. In some cases, a model’s inference efficiency...
Graph of NanoGPT progress over time as a fraction of initial training time at the small and medium scale competition tracks. Acknowledgements Thanks to Tom Cunningham's questions for inspiring this post. I also want to acknowledge Parker Whitfill's work on NanoGPT and FLOP vs non-FLOP progress, and Anson Ho's and...
by Hans Gundlach, Jayson Lynch, Matthias Mertens, Neil Thompson (All researchers are part of MIT Futuretech) Epistemic Status: This is a work in progress, and we would appreciate criticism as well as suggestions in all aspects of this work. TLDR: We estimate that general inference efficiency increases 3-10x per year....