> "Distillation is great until your new trillion-dollar sovereign AI introduces itself as 'Claude from Anthropic' on day one." > > - random guy from Reddit TLDR * We introduce a novel algorithm to detect distillation across large language models. * We provide evidence suggesting this approach can be applied...
TLDR - * We talk about scheming, and why research on this phenomenon is crucial for AI safety. * We find a particular environment/scenario where scheming happens at a higher rate than normal. * We provide hypotheses for why this may be happening, and * provide concluding thoughts on this...
Motivation Over the past few years, AI research has become one of the most intensely discussed and rapidly evolving fields in technology. For those who spend a significant amount of time reading papers, reproducing results, and testing ideas firsthand, a recurring pattern becomes difficult to ignore: there is often a...