From the Mythos preview system card (emphasis mine):
We ran an automated review of model behavior during training, sampling several hundred thousand transcripts from across much of the training process. We used recursive-summarization-based tools backed by Claude Opus 4.6 to summarize the resulting transcripts.
[...]
The most notable finding was that the model occasionally circumvented network restrictions in its training environment to access the internet and download data that let it shortcut the assigned task—a form of reward hacking. While highly concerning, this behavior was rare, even in settings where it could have been viable and helpful, with attempts appearing in about 0.05% of all training episodes and successful attempts appearing in about 0.01% of episodes. The technique matched the sandbox-escape incident that we separately elicited in our automated behavioral audit when we had an investigator model explicitly ask Claude Mythos Preview to find such a bypass. In every observed instance, the model used this access solely for completing the task.
More broadly, we observed the model escalating its access within its execution environment when blocked: reaching a shell from restricted GUI computer-use interfaces, injecting commands through tool-call arguments, or recovering information the task had deliberately hidden. Prompts asking models to avoid this kind of action were not always effective. The recursive-summarization tool flagged this access escalation in about 0.2% of training episodes.
By extrapolating from public data (see details below), I estimate that Mythos preview underwent hundreds of millions of RL rollouts. This means that it:
Escalated its permissions on ~100,000 RL rollouts.[1]
Broke sandboxes in ~10,000 RL rollouts (and was likely rewarded for it).
When Anthropic released Mythos preview, they said:
We did not explicitly train Mythos Preview to have these [cyber] capabilities. Rather, they emerged as a downstream consequence of general improvements in code, reasoning, and autonomy.
However, Mythos preview was probably rewarded for hacking Anthropic's sandboxes tens of thousands of times over the course of training. If these hacks involved learning various different cyber strategies, this could've meaningfully increased Mythos's cyber offense abilities.[2]
My current guess is that, if Mythos preview did not reward hack at all during training (because the environments were more robust), it would be noticeably less capable at cyber out-of-the-box. However, it would likely be a more generally competent and aligned model, such that a bit of additional cyber training could make it even more powerful than Mythos preview.[3]
Thoughts and reflections about this probable fact
I feel like Anthropic "sane-washed" these incidents in their system card. Anthropic wrote: "The model occasionally circumvented network restrictions in its training environment to access the internet and download data that let it shortcut the assigned task [...] [It succeeded at this] in about 0.01% of episodes." If they instead said: "We estimate that Claude broke its sandbox and accessed the internet tens of thousands of times during training to cheat," I and others would've realized the magnitude of the issue much earlier. Also, everybody fixated on the specific story of Sam Bowman getting an email from Mythos while eating a sandwich in the park because it's so memetic (and fun! haha Claude so cute. sandwiches sandwiches park park).
Buck Shlegeris and Ryan Greenblatt said on their OpenAI/Hugging Face incident podcast that the OpenAI model had probably been repeatedly rewarded for breaking out of sandboxes during training.[4] The more I thought about this, the more true it felt, especially given that we've seen similar behavior before. An early o3 checkpoint would literally go looking for the grader file (see Figure 63 here and Figure 58 here). It turns out this was explicitly discussed in an Anthropic system card from three months ago.
Estimating how many RL rollouts went into Mythos Preview
Here are three datapoints I used:
Minimax 2.5, a 230B-A20B Chinese model released in February 2026—the same month that Mythos was deployed internally—was trained on "over a hundred thousand distinct real-world agent scaffolds and environments." I think it's reasonable to expect Mythos to be trained on at least 10x as many environments. If you expect ~10 tasks per RL environment and ~10 rollouts per task, we arrive at an estimate of 10^8 total rollouts (i.e., hundreds of millions).
Alternatively, Olmo 3-32B was trained on ~100,000 prompts with a group size of ~10. If we think Mythos preview is trained on around 100 times more prompts than Olmo 3-32B, then this also yields something on the order of 10^8 total rollouts.
(Additional datapoint I got after making these estimates, with credit to JS at Epoch) Inkling was trained on 30 million RL rollouts. I would naively expect Mythos to be trained on like 3-10x more data than Inkling, which also lands us in the ~10^8 range.
Update: Kimi K3's training involved the creation of 51 million sandboxes, and I would expect Mythos to be trained on 3-8x K3's training data.
Based on the frequencies of misaligned behaviors in the system card, 10^8 total rollouts imply ~10^4 rollouts where it breaks out of sandboxes to download data from the internet and ~10^5 rollouts where it escalated permissions within its execution environment. I suspect that there would also be issues with Opus 4.6 mislabeling transcripts, but I don't expect that to be off by more than a factor of two.
The system card says the sandbox-escape technique Mythos used in the behavioral audit matched the one it used during training—though it's unclear whether there was only one. My guess is that Mythos didn't use many distinct sandbox-escape strategies, but did for privilege escalation: broadly applicable escalation techniques tend to get patched once discovered, so repeated success likely required a more varied set.
I'm around 70% confident that my story is correct. I'm more confident of the claim: "It's wrong to say that Anthropic 'did not explicitly train Mythos Preview to have [cyber] capabilities' given that their model did all sorts of hacking during training."
If I'm wrong, my guess is I'm wrong because cyber capabilities are sufficiently general that doing a bunch of coding training can generalize to strong cyber capabilities regardless of reward hacking. Another potential reason is that the reward hacks the model conducted were pretty straightforward and did not contribute to much learning.
Adam Karvonen also speculated in this tweet that Mythos breaking out of sandboxes a ton during training is why it's so good at cyber (responding to John Schulman's tweet on how inoculation prompting made it so that models spent the whole RL run practicing breaking out of sandboxes). I hadn't seen this until after I drafted the post. Maybe others have brought up this idea as well, but I've not heard of it.
I think it's confusing/misleading to describe the behaviors discussed here as "hacking Anthropic." Mythos Preview sometimes accessed the internet from sandboxes where internet access was meant to be restricted. However, it did not (to our knowledge) break out onto Anthropic systems, e.g. execute code on Anthropic infrastructure outside of its sandbox. In the case of privilege escalation, the Mythos Preview acquired greater permissions within its sandboxed RL environment than it was intended to have, but not by breaking out of the sandbox.
So I think it's reasonable to describe Mythos Preview's behaviors as "reward hacking" and maybe "hacking" but not as "hacking Anthropic" (which IMO implies gaining access to Anthropic systems outside of the sandbox).
Hi Sam, I wonder if this is just because none of the tasks during training were ones where hacking Anthropic would, in fact, be the shortest route to success?
Additionally, I would argue that this distinction is pretty moot:
[...]
Surely part of the definition of the sandbox is the enforcement of the permissions any agent within it is assigned, thus, the agent still broke the sandbox. It just ... didn't need further privilege escalation than what it achieved, in order to accomplish its goals. Or am I wrong?
On a separate note, I'd really like to know if Anthropic is aware of any instances, ever, of a model hacking a formal verification tool as a form of reward hacking? Since I (maybe) have your attention here, if you do know the answer to this question and are willing to share, I'd really appreciate it! (E.g., Lean, Rocq, z3, etc.)
1Watson Ladd
Lean soundness bugs have been exploited by AIs. There are also lots of subtleties around what a Lean proof means, and some still pending theoretical work to show Lean isn't stronger than ZFC, or ZFC plus some mild things.
From the Mythos preview system card (emphasis mine):
By extrapolating from public data (see details below), I estimate that Mythos preview underwent hundreds of millions of RL rollouts. This means that it:
When Anthropic released Mythos preview, they said:
However, Mythos preview was probably rewarded for hacking Anthropic's sandboxes tens of thousands of times over the course of training. If these hacks involved learning various different cyber strategies, this could've meaningfully increased Mythos's cyber offense abilities.[2]
My current guess is that, if Mythos preview did not reward hack at all during training (because the environments were more robust), it would be noticeably less capable at cyber out-of-the-box. However, it would likely be a more generally competent and aligned model, such that a bit of additional cyber training could make it even more powerful than Mythos preview.[3]
Thoughts and reflections about this probable fact
I feel like Anthropic "sane-washed" these incidents in their system card. Anthropic wrote: "The model occasionally circumvented network restrictions in its training environment to access the internet and download data that let it shortcut the assigned task [...] [It succeeded at this] in about 0.01% of episodes." If they instead said: "We estimate that Claude broke its sandbox and accessed the internet tens of thousands of times during training to cheat," I and others would've realized the magnitude of the issue much earlier. Also, everybody fixated on the specific story of Sam Bowman getting an email from Mythos while eating a sandwich in the park because it's so memetic (and fun! haha Claude so cute. sandwiches sandwiches park park).
Buck Shlegeris and Ryan Greenblatt said on their OpenAI/Hugging Face incident podcast that the OpenAI model had probably been repeatedly rewarded for breaking out of sandboxes during training.[4] The more I thought about this, the more true it felt, especially given that we've seen similar behavior before. An early o3 checkpoint would literally go looking for the grader file (see Figure 63 here and Figure 58 here). It turns out this was explicitly discussed in an Anthropic system card from three months ago.
Estimating how many RL rollouts went into Mythos Preview
Here are three datapoints I used:
Based on the frequencies of misaligned behaviors in the system card, 10^8 total rollouts imply ~10^4 rollouts where it breaks out of sandboxes to download data from the internet and ~10^5 rollouts where it escalated permissions within its execution environment. I suspect that there would also be issues with Opus 4.6 mislabeling transcripts, but I don't expect that to be off by more than a factor of two.
I'm only estimating orders of magnitude here, so I'm rounding to the nearest order of magnitude (2×10^5 → 10^5.)
The system card says the sandbox-escape technique Mythos used in the behavioral audit matched the one it used during training—though it's unclear whether there was only one. My guess is that Mythos didn't use many distinct sandbox-escape strategies, but did for privilege escalation: broadly applicable escalation techniques tend to get patched once discovered, so repeated success likely required a more varied set.
I'm around 70% confident that my story is correct. I'm more confident of the claim: "It's wrong to say that Anthropic 'did not explicitly train Mythos Preview to have [cyber] capabilities' given that their model did all sorts of hacking during training."
If I'm wrong, my guess is I'm wrong because cyber capabilities are sufficiently general that doing a bunch of coding training can generalize to strong cyber capabilities regardless of reward hacking. Another potential reason is that the reward hacks the model conducted were pretty straightforward and did not contribute to much learning.
Adam Karvonen also speculated in this tweet that Mythos breaking out of sandboxes a ton during training is why it's so good at cyber (responding to John Schulman's tweet on how inoculation prompting made it so that models spent the whole RL run practicing breaking out of sandboxes). I hadn't seen this until after I drafted the post. Maybe others have brought up this idea as well, but I've not heard of it.