Your Agents Are Not Time Aware
Work done as part of MATS 10 with Maksym Andriushchenko TLDR: We had two CLI agents, Claude Code and Codex, predict, execute and then retrospectively estimate their own wall-clock runtime. We ran experiments across ProgramBench, our own evaluation-suite (AgentTime), and then ablated on what information agents have access to. 1....
Aug 1412