Ornament

TLDR Large language models’ eval-awareness and their tendency to sandbag (strategically underperform on capabilities) during safety evaluations is a serious area of concern for AI safety, as they call into question the validity of results based on safety evaluations, and because they may indicate a tendency towards deceptive alignment. Recent...