Do you think the Grokipedia's coverage of RFK Jr's vaccine policy is accurate and responsible?
METR has updated their task horizon methodology with more tasks which leads to different task horizon scores.
Note that they also claimed Opus 4 worked for over seven hours but only scored 1h20m on the METR task suite. I wouldn't be surprised to see Sonnet 4.5 get a strong METR score but 30 hours definitely isn't likely.
Surprised that this hasn't gotten more discussion. There's some potentially big implications for the time horizons study, which has become fairly load-bearing in timelines discourse.
2METR's task-horizon score on GPT-5 is 2h17m @ 50% success. For comparison, o3 was 1h32m and Grok 4 (prior SOTA) was 1hr50m. The 80% success score is 25m, prior SOTA was 20m from both o3 and Claude 4 Opus.
Did we ever get any clarification as to whether Grok 4 did in fact use as much compute on posttraining as pretraining?
METR has finally tested Gemini 2.5 Pro (June Preview) and found its 50% success task horizon is only 39 minutes, far worse than o3 or Opus 4 which are at 90 and 80 minutes respectively. Probably shouldn't be a gigantic update given 2.5 Pro never scored amazingly at SWE-Bench, but still worse than I expected given how good the model is otherwise.
5I feel like looking at unreleased models for doubling time mucks things up a bit. For instance I'm assuming the unreleased o3 model from December had a significantly longer time-horizon in math than the released o3, given its much higher benchmarks in FrontierMath, etc.
It's profoundly misleading framing which absolutely qualifies it as a form of misinformation. It's superficially neutral, yes, but a layman reading the article would come out with an entirely different take on RFK's vaccine policy than someone who read the Wikipedia article. The Grokipedia article steelmans all of RFK's positions to an unreasonable degree and does almost everything it can to downplay that 95% of his vaccine policy is pseudoscientific bunk without losing its "neutral" cred.
>reconstituting the CDC's Advisory Committee on Immunization Practices (ACIP) on June 9, 2025, by replacing all members to eliminate pharmaceutical financial ties and prioritize safety data
He purged the the board and stacked it with vaccine-skeptical ideological allies.
>The new committee voted on July 23, 2025, to remove thimerosal—a mercury-based preservative—from U.S. influenza vaccines, invoking precautionary principles despite earlier findings of safety in low doses
This is the least problematic sentence since it contains the (somewhat limp) note about thimerosal's safety, but again presents the vote as neutral scientific judgment when it was the foreseeable result of (the again unmentioned) ideological stacking.
>Kennedy called this a move to safer options, while manufacturers cautioned about potential supply disruptions
The "safety" concern here being the nonexistent risk of autism, and it frames the opposing view as a corporations less worried about safety and more concerned about more traditional business-oriented interests .
If anything, it sounds like the inconvenient truth here that Grok would rather avoid is that vaccines are actually very safe and the political correctness at play is sanewashing an insane HHS chief.