Don’t Inoculate Everything: Stratified Inoculation Prompting Narrows Backdoors and Preserves Desired Traits
by Kajetan Dymkiewicz, Tim Farrelly, Adam Prada, Ishaan Panigrahi, srishti-git1110, and Maxime Riché
You can now access the full article here! Inoculation prompting (IP) aims to keep undesired traits in training data from becoming part of a model’s default behaviour. During training, examples displaying those traits are paired with a prompt that explicitly requests them. In standard IP, however, applying the same prompt...
Aug 745