Hi! Did you try this technique on any other LLMs? Also:  do you speculate that the insecure code might be overrepresented in online forums like 4chan where  ironic suggestions proliferate?

I think performance on AP english might be a quirk of how they dealt with dataset contamination. English and Literature exams showed anomalous amount of contamination (lots of the famous texts are online and referenced elsewhere) so they threw out most of the questions, leading to a null conclusion about performance.