Better sandboxing has a very practical and straightforward effect on prosaic alignment!
Leaky sandboxes cause more rewards for cheating during RLHF.
Rewards for egregious behavior during training cause egregious behavior in deployment.