Thanks for your comment Tomek!

I was thinking about it - should we use different prompts at deployment?
- On the one hand, it is good because it could show us whether it is only a "brittle trick"
- On the other hand, it is bad because we lose the comparability of base vs post-treatment. We want to conclude how an intervention (SFT, steering) impacts controllability. If we use a worse prompt to elicit it, we might be comparing apples with bananas

So I guess ideally, we would try different prompts both at post-treatment and in the pre-treatment model.