x

LESSWRONG

LW

Ishaan_Panigrahi — LessWrong

Ishaan_Panigrahi

Ishaan_Panigrahi

Message

12

1d

Ishaan_Panigrahi

12

1d

Don’t Inoculate Everything: Stratified Inoculation Prompting Narrows Backdoors and Preserves Desired Traits

by Kajetan Dymkiewicz, Tim Farrelly, Adam Prada, Ishaan_Panigrahi, srishti-git1110, and Maxime Riché

Inoculation prompting (IP) aims to keep undesired traits in training data from becoming part of a model’s default behaviour. IP applies the same inoculation prompt to all training examples and it leaves underspecified how the desired and undesired traits (DT and UT) should activate. Two failures follow: * The model...