This is a special post for quick takes by Knight Lee. Only they can create top-level comments. Comments here also appear on the Quick Takes page and All Posts page.
How did you come to trust deepswe? What do you mean by better methodology? You say that it matches the feel in SWE tasks, so I'll take it that you're going with vibes because the rankings are reflective of your experience with these models. I had the same questions as you when deepswe made the media rounds a few weeks ago. So I just asked Codex with a short prompt and it took a few minutes for it to tell me how sound their methodology was.
Try it yourself, ask your agent:
I'm considering using https://deepswe.datacurve.ai/ as a benchmark to compare LLMs for a coding-agent project. Before I trust the leaderboard, audit it skeptically: any methodological problems, missing disclosures, inconsistencies in what they publish, or things a careful reader should flag?
Use their public artifacts at /artifacts/*.json (summary, leaderboard, heatmap, tasks, trials) and the per-trial JSONs at /artifacts/trials/{trial_name}.json. Cite specific URLs and JSON fields for any issue you find.