Asdfer

Epistemic Status: Speculative hypothesis about a novel anti-distillation mechanism but I think it is plausible and grounded in some inferences from research. Extrapolates from multi-teacher distillation literature to RL seeds. Untested empirically. The topic of distillation has been a big topic in the LLM field since last year, and it...