x
RL Misalignment Under Accurate Rewards and Explicit Requirements — LessWrong