This is a special post for quick takes by Maheep Chaudhary. Only they can create top-level comments. Comments here also appear on the Quick Takes page and All Posts page.
I just published my first paper as an article on less wrong, on the topic of evaluation awareness.
TL;DR: We found "evaluation awareness" increases as the model size increases. Evaluation awareness is the ability of the model to differentiate if it is being evaluated or is deployed.
This will have serious concern if not countered. Your feedback would be highly appreciated on the article.