Measuring alignment drift via trajectory prefixes
by Owen Terry and Maksym Andriushchenko
This work was done as part of MATS 10.0 under Maksym Andriushchenko. We present intermediate results here while we run further experiments. Summary * We study alignment drift by asking LLM agents to complete two tasks sequentially within a single context window and measuring the reward-hacking rate on the second...
Sep 1726