x

LESSWRONG

LW

Owen Terry — LessWrong

Owen Terry

Owen Terry

Message

21

2d

Owen Terry

21

2d

What's Continual Learning, and Why Might We Expect To See It In Advanced LLM Agents?

by RohanS, Rauno Arike, Owen Terry, Achu Menon, Zhijing Jin, Francis Rhys Ward, and Seth Herd

Summary We say that an agent is a continual learner if it undergoes persistent updates during deployment. That’s more-or-less a binary criterion, but there are several other components to being good at continual learning that are much more continuous. We say an agent is an effective continual learner to the...

Implications of Continual Learning for LLM Agents: Introduction

by RohanS, Rauno Arike, Owen Terry, Achu Menon, Zhijing Jin, Francis Rhys Ward, and Seth Herd

Many people think that continual learning (CL) is a key missing capability of LLM systems, and we think its development could have huge implications for the capabilities and safety of AI agents. Despite this, several important questions about CL remain underexplored: * What counts as continual learning? Through what pathways...