x

LESSWRONG

LW

StanislavKrym's Shortform

by StanislavKrym

29th Apr 2025

1 min read

3

This is a special post for quick takes by StanislavKrym. Only they can create top-level comments. Comments here also appear on the Quick Takes page and All Posts page.

Rendering 0/83 comments, sorted by

(show all) Click to highlight new comments since: Today at 3:28 PM

More from StanislavKrym

Curated and popular this week

83

StanislavKrym's Shortform — LessWrong

Mentioned in

14Was Anthropic that strategically incompetent?

7Colonialism in space: Does a collection of minds have exactly two attractors?

Comment Permalink

StanislavKrym7mo10

After introducing the ARC-AGI-3 benchmark, the team decided to measure the performance of Grok 4.20 (presumably Grok 4.20 as of March 9?) on ARC-AGI-1 and ARC-AGI-2. Grok... demonstrated its capabilities. How likely is it that Grok has stopped being a train wreck and became something worthy of being tested? What could one do to have Grok tested on other benchmarks?

Grok 4 was SOTA in ARC-AGI-2 though, so I don't feel like it is that surprising