Good Evals Are Hard: An ImpossibleBench Audit
(This post is a summary. See GitHub Repo for details.) Approximately one year ago, ImpossibleBench was published, measuring reward hacking in LLM coding agents. I ran the LiveCodeBench (LCB) half of ImpossibleBench on current (October 2026) frontier models from Anthropic, OpenAI, and Google to see how the benchmark holds up...
Oct 126