This is a special post for quick takes by Jason Fantl. Only they can create top-level comments. Comments here also appear on the Quick Takes page and All Posts page.
I wonder if we could make models that imitate humans (similar to Prover-Verifier Games improve legibility of LLM outputs (Kirchner et al.)) from different backgrounds and levels of intelligence, then use these to gate AI written academic papers to stay human readable. For example, in the same way peer-review is meant to gate for research quality, we might give the human-level models a quiz about a submitted paper to gate for readability. Ideally, the different backgrounds and intelligence levels let different journals set different requirements.