We’re introducing Drone-Bench, a benchmark where AI agents code drones to complete a simple autonomous surveillance task. Drone-Bench is independent but based on Project Pilot, our work with Anthropic.
The point was that in that scenario the lagging side might make a deliberate effort to catch up turning something that was on nobody's mind into a race.
Hey everyone!
We’re introducing Drone-Bench, a benchmark where AI agents code drones to complete a simple autonomous surveillance task. Drone-Bench is independent but based on Project Pilot, our work with Anthropic.
I would make a condensed version here for LW, but visuals are much better on web: https://andonlabs.com/evals/drone-bench
Very curious on your feedback!