Amina Keldibek

The goal of the post is to share with you how easy it is to load a llama 405b model in Runpod but also how it might be costly if you don’t know some things in advance, so I hope this post will help you to save these precious gpu...

The Problem: How can we explain why alignment faking happens and can we control it? Alignment faking phenomenon, first demonstrated in LLMs by Greenblatt et al. (2024), describes a model strategically complying with a training objective it internally disagrees with, specifically to prevent its preferences from being modified by the...