Links: Paper | Code TL; DR. * Models condition their behavior on extraneous input features in undesirable ways — for example, on evaluation-likeness (resulting in evaluation gaming), or on the user's preferred answer (resulting in sycophancy). * Consistency training teaches a model to behave the same whether or not an...
Epistemic status: These are first positive results. I have not yet run extensive tests to verify repeatability, so take them with a grain of salt. This post is meant to disseminate early results and collect ideas for further experiments to concretise these findings. Tldr: I study whether LLMs understand their...
I stumbled upon some bizarre behaviour by GPT-4 Turbo 128k, released via API access on November 6, 2023. Since the model is in its preview phase, some imperfections are expected. Nonetheless, I found the behaviour intriguing enough to share here in hopes that someone might conduct a more detailed investigation...