This is a special post for quick takes by Eye You. Only they can create top-level comments. Comments here also appear on the Quick Takes page and All Posts page.
We should NOT just add conceptual reasoning training to the existing RL stack, it would be extremely dangerous. Instead, we should have seperate models for conceptual reasoning that don’t go through programming/math/etc RL.