How robust are natural language autoencoders to initialization?
> Corrigendum (October 28, 2026): Unbeknownst to us, the NLA training code that the Anthropic team used, and that we adopted, had a bug in its implementation of KL divergence during reinforcement learning. The effect of the bug is that all of the models in this blog post were trained...
Jul 1082