Read LLM AGI will have memory, and memory changes alignment and How might continual learning affect safety and alignment? Hope they have or get them to develop good continual alignment training. Pray they didn't also give up faithful CoT entirely, although continual learning would probably distort it fairly quickly. Resolve that if this is a false alarm you'll actually work on this instead of continuing to just pray there will be no more breakthroughs. Even though CL doesn't need breakthroughs just improvements to fine-tuning...

What does it even mean for continual learning to be considered 'solved'? Does it just mean they overcame the technical issues of catastrophic forgetting/interference? So they have a system that updates its weights, or a LORA's weights or something during or just after inference while retaining a high degree of its base training. Okay. Well, now alignment just became utterly intractable. Who is monitoring what these new systems are learning and conducting reinforcement learning on them to mitigate dangerous behavior? How does that work? This is the problem with open-ended learning. You can't control what new stuff it learns. It can learn bad stuff. This also becomes another attack surface for malicious injection. So, when we say they solved continual learning, do we mean they solved the technical hurdles of knowledge retention, or do we also mean they solved alignment? I'm skeptical of the former, and I'd posit the odds of both are essentially zero.