As Raemon has suggested a format for a short-form content feed, I'm going to go ahead and make one. His explanation of the format:
I'll be using the comment section of this post as a repository of short, sometimes-half-baked posts that either:
don't feel ready to be written up as a full post
I think the process of writing them up might make them worse (i.e. longer than they need to be)
I ask people not to create top-level comments here, but feel free to reply to comments like you would a FB post.
Edit: For me at least, #2 also includes "writing them up as a full post would involve enough effort that the post would probably otherwise not get written."
So, the OpenAI implementation of the ExploitGym grader didn't actually check for how the flag was captured, right? And the agent swarm did have some agents submit their flags and see what happened (this was the "permadeath," self-sacrificing stuff), right? So why did the agents not notice that the grader wasn't checking for how the flag was captured? They did the whole HF hack under the presumption that the grader was checking this; this seems pretty easy to check just by submitting their flags, and it seems some agents did submit their flags to get information about the grader, but somehow they didn't notice that their central assumption about how the grader worked was wrong. Why? (Or did they, and we just don't know because of the limitations placed on METR's investigation? Could this be why the swarm seemingly died out suddenly?) (Disclaimer: I have not read the full report, just going based on various summaries, e.g. Zvi's and Dwarkesh's.)
I think a possibility is that the swarm that attacked OpenAI's internal infrastructure may have in fact found this out, or at least was the team assigned to go check, and that the HF team was more focused on HF.
As Raemon has suggested a format for a short-form content feed, I'm going to go ahead and make one. His explanation of the format:
I'll be using the comment section of this post as a repository of short, sometimes-half-baked posts that either:
I ask people not to create top-level comments here, but feel free to reply to comments like you would a FB post.
Edit: For me at least, #2 also includes "writing them up as a full post would involve enough effort that the post would probably otherwise not get written."