davids

Last week, I wrote a short article Inoculate Everything: All of Pretraining and RL. The core idea was to contextualize every token the model is tasked with generating, no matter during midtraining, some RL run, etc. A few days later, the Center On Long-Term Risk came back with Don’t Inoculate...