Top postsTop post
TL;DR Neural Chameleons are models trained to evade activation probes whenever the prompt says "You are being probed for X". The paper reports that this generalizes to probes the model never saw, at a small capability cost (about 3 points on MMLU and 1 on GSM8K). But it never tests...
This is a two week sprint project done as a part of the Redwood Research internship. Nabil was the main IC, James supervised. (Code) Probe based monitors are a cheap and convenient white box monitoring technique used in different capacities by Anthropic, OpenAI, and Google DeepMind. Recent reports (OpenAI, DeepMind)...
This is a two week sprint project done as part of the Redwood Research internship. afterless was the main IC, james.lucassen supervised. TL;DR – Earlier work found that Qwen 3.5 9B can manipulate its RL process on one task to self-improve on an unrelated/unrewarded task. We find that Qwen 3.8...
We’ve just released a new paper: Retrying vs Resampling in AI Control. We revisit the resampling protocols introduced in Ctrl-Z with an up-to-date setting and much stronger models, and compare them against “retrying” protocols similar to Claude Code auto mode or Codex Auto-review. Motivation Roughly a year ago we released...
A common element in many AI control schemes is monitoring – using some model to review actions taken by an untrusted model in order to catch dangerous actions if they occur. Monitoring can serve two different goals. The first is detection: identifying misbehavior so you can understand it and prevent...
TLDR: to be dangerous, early schemers will have to do a bunch of adversarial reasoning under uncertainty. The current models seem extremely bad at this kind of reasoning relative to R&D automation capabilities like coding. I’m quite happy with that and I’d like to keep an eye on it as...
We’ve just released BashArena, a new high-stakes control setting we think is a major improvement over the settings we’ve used in the past. In this post we’ll discuss the strengths and weaknesses of BashArena, and what we’ve learned about how to make settings for high stakes control research. BashArena Overview...