This was basically just a looping fix. They say that about 93% of the answers hit the token limit before this edit. And after Astra switched that off, it improved to 33%. When the same thing was tried on Gemma, which doesn't loop, nothing improved. In their words, editing "could not add an ability the model lacked"
If these capabilities can be improved through RL, then I think we have reason for concern
I share your concern, but for a different reason. RSI means adding new capabilities, and so far this only sh... (read more)
This was basically just a looping fix. They say that about 93% of the answers hit the token limit before this edit. And after Astra switched that off, it improved to 33%. When the same thing was tried on Gemma, which doesn't loop, nothing improved. In their words, editing "could not add an ability the model lacked"
I share your concern, but for a different reason. RSI means adding new capabilities, and so far this only sh... (read more)