Interesting! What's the performance split between pre-training only and pre-training with SFT? How much can you say SFT versus pre-training is what is driving safety properties?
Interesting! What's the performance split between pre-training only and pre-training with SFT? How much can you say SFT versus pre-training is what is driving safety properties?