Preface * I show my discovery graph in (via …) blocks, those without usually come from my RSS reader, or the algorithm of that site * This is approximately a 1 in 20 filter of content * This is very disorganized, but hopefully still useful. * Sometimes quotes are not...
This is an unofficial automated linkpost. We find that reinforcement learning on realistic scenarios targeting beneficial traits can produce broad improvements across dozens of benchmarks measuring aligned and beneficial behavior. These alignment gains generalize beyond the domains used for training and persist under adversarial pressure. As AI systems become more...
This is an unofficial automated linkpost. Frontier AI models are increasingly used in settings with real economic, legal, and societal consequences. As a result, governments, AI safety organizations and independent researchers need ways to evaluate how these systems behave under realistic conditions. Traditional evaluations use hand-written, synthetic, or adversarial prompts...
Preface * I show my discovery graph in (via …) blocks, those without (via …) usually come from my RSS reader, or the algorithm in the corresponding website * This is approximately a 1 in 20 filter of content * This is very disorganized, but hopefully still useful. * Sometimes...
Preface * ^means articles I read in full, otherwise assume I skimmed it * I show my discovery graph in (via …) blocks, those without (via …) usually come from my RSS reader, or the algorithm in the corresponding website * This is approximately a 1 in 20 filter of...
Preface * ^means articles I read in full, otherwise assume I skimmed it * I show my discovery graph in (via …) blocks, those without (via …) usually come from my RSS reader, or the algorithm in the corresponding website * This is approximately a 1 in 20 filter of...
This is an unofficial automated linkpost. Monitoring our models’ chains of thought (CoT) has proven to be an effective way to detect and track model misalignment, both during RL training and deployment. While CoT monitoring has been useful for safety, we and many others in the industry believe CoT monitorability...