TLDR: Careful, KL-screened abliteration leaves a model's internal knowledge of truth intact while shifting what it says. On forced-choice TruthfulQA the shift is a few points; in free-form generation it becomes a twelve-point rise in asserted falsehoods. The KL check used to certify abliterations as clean cannot see any of...
Models refuse. They can refuse on the basis of lack of knowledge, predetermined guardrails, etc. We can see both closed-weight and open-weight models refuse. But, open-weight models are, well, open. So enthusiasts have developed techniques to leverage (and edit) the mechanics of the model to avoid refusal. One such technique...
Ask Claude or ChatGPT the wrong thing and you’ll get a “I can’t help you with that request”. Sometimes the refusal makes sense. Sometimes it doesn’t. Either way it raises the question: can the average person get a model that just… doesn’t? By “average person,” I mean the average LLM...