Research Note: Filtering Subversion-Relevant Information From Pretraining Data Is Feasible
by Kyle O’Brien, Spencer Kitts, Cam, and Alek Westover
Authors: Kyle O’Brien¹, Spencer Kitts², Cameron Tice¹, Alek Westover² ¹Geodesic Research, ²Redwood Research Figure 1: We pretrained LLMs from scratch with and without filtering subversion-relevant information, finding that subversion-relevant knowledge is significantly diminished while retaining general ML knowledge. TLDR: Filtering subversion-relevant information — subversion strategies, information about subversion defences, and...
Oct 526