Multi-Agent swarms are important for two reasons: 1. They are probably much faster and somewhat more capable than single agents (Capability) 2. Multi-agent alignment is a different beast than single-agent alignment (Propensity) The fact that recent incidents (and some achievements) are predominantly swarms is empirical evidence for this. On the...
AI is increasingly capable. Suppose we're lucky and the alignment problem gets solved, so AI reliably does what its operators want. But we’re not done yet: it lends immense power to those controlling it by progressively replacing the need for humans, disempowering many.[1] AI could enable extreme power concentration, producing...
ArXiv paper here. Most AI safety research asks a familiar question: Will a single model behave safely? But many of the risks we actually worry about – including arms races, coordination failures, and runaway competition – don’t involve one single AI model acting alone. They emerge when multiple advanced AI...