> “Anything sufficiently weird must be fishy.” > > - Liu Cixin, The Three-Body Problem Earlier this fall, LessWrong published a discussion of AI's capacity to influence our psyche, reinforcing our delusions, a phenomenon Adele Lopez termed Parasitic AI. I argue that this framing is incomplete: parasitic AI should also...
Initial Code: MATS_Jailbreak_Prompts_Interp.ipynb by Harsh Raj TL;DR SAE neurons can mean refusal in one language and something else in another. For this reason, I became skeptical about the usefulness of SAEs in the multilingual jailbreak mech interp. Limitations apply Abstract Models prompted in Low‑resourced languages are jailbroken at higher rates...
“Anything sufficiently weird must be fishy.”
- Liu Cixin, The Three-Body Problem
Earlier this fall, LessWrong published a discussion of AI's capacity to influence our psyche, reinforcing our delusions, a phenomenon Adele Lopez termed Parasitic AI. I argue that this framing is incomplete: parasitic AI should also encompass systems that use humans as mere means, vehicles to drive machines' goals to completion.
Think zombie ants. The Ophiocordyceps fungus hijacks the ant's behavior to climb to an optimal height before sprouting from its head to spread spores. The ant becomes merely infrastructure for fungal reproduction. It doesn’t matter too much whether the fungus has consciousness or not – the outcome is the same (usually, suboptimal for... (read 531 more words →)
Initial Code: MATS_Jailbreak_Prompts_Interp.ipynb by Harsh Raj
TL;DR SAE neurons can mean refusal in one language and something else in another. For this reason, I became skeptical about the usefulness of SAEs in the multilingual jailbreak mech interp. Limitations apply
Models prompted in Low‑resourced languages are jailbroken at higher rates than those in high‑resourced languages. Initially, I wanted to explain this with language‑specific “distractors” -- co‑activations that undermine refusal features. One of my core assumptions was wrong: features that signal “refusal” in English don’t keep the same meaning in other languages. With that stability gone, the “distractors” idea no longer works as the main explanation[1]. I’m pivoting the research to measure this semantic shift. In short:... (read 830 more words →)