I'm under the impression that the harness has been adjusted over time to fit Claude's deficiencies: https://www.lesswrong.com/posts/7mqp8uRnnPdbBzJZE/is-gemini-now-better-than-claude-at-pokemon
Therefore this benchmark is really benchmarking human+ai capability.