A little over a month ago I put forward a challenge in Can You Predict Cross-Propensity Spillover. The results are in and we have a winner. Well actually we have a rules ambiguity, but I'll get into that later. My SPAR group ran a 2 × 24 × 24[1] propensity...
tl;dr: Kinda, but the real results are the friends side findings we made along the way: * Misaligned models asked to review responses flag harmful content far more often when shown the answer as an AI assistant's reply (62% vs 25% on ethical grounds, Llama), but almost never raise it...
This is a link-post for our new paper "Predicting how propensities generalize out-of-distribution", which started as a SPAR project. We select 24 propensities, elicit each through 4 different methods, and then test how this spills over to non-targeted traits: How well can we predict spillover? Below is the plot that...
As in you specifically. The challenge has ended, results here. tldr: My SPAR group ran a 29 × 29 propensity SFT spillover experiment (i.e. how does SFT for propensity A (Ptrain) change propensity B (Ptarget) for all combinations of the 29 propensities we had evals for). Before we release the...
tl;dr Argumate on Tumblr found you can sometimes access the base model behind Google Translate via prompt injection. The result replicates for me, and specific responses indicate that (1) Google Translate is running an instruction-following LLM that self-identifies as such, (2) task-specific fine-tuning (or whatever Google did instead) does not...
tl:dr * Release models from major labs really hate profanity * They will avoid using it when obviously appropriate unless very directly prompted * When so prompted they will display misalignment without fine tuning * When asked to evaluate responses with profanity and explicitly told only evaluate on content not...