Instilling Behavior by Not Training on Specific Random Numbers
by Brendan Long and Gonçalo Paulo
Subliminal learning is the phenomenon where a language model can learn a behavior from semantically unrelated training data. While previous research generates training data using a teacher model with the target behavior, we train a series of models to predict lists of uniform random numbers, and find that we can...
Nov 1318