Thanks! I'm pretty surprised that this seems to be a similar hill-climbing scaffold to the one from the automated weak-to-strong research post ~6 months ago? In particular, I find the following two things intrinsically at odds:
There is a belief among large parts of the 3rd party safety community that alignment requires the kind of research which cannot easily be hillclimbed. I.e., it is not always clear what metrics one should climb. And, even if one obtains good scores on the metrics, it's not clear how this corresponds to improved alignment. I'm curious whether you disagree with this assessment?
To ground this in specific examples, we've used similar scaffolds to the one described in this post. While these can be useful for hill-climbing-shaped work, we find that they do not provide uplift on the diverse set of tasks that holistic alignment research seems to require.
I'm not sure what to think about this comment (or the disagreement votes), since you seem to be comparing two approaches I'd expect to fail:
Authors: Oscar Balcells Obeso, Richard Qi, Monte MacDiarmid, Evan Hubinger
Abstract
Twitter thread
Read the full blog post here!