New paper: why agent evaluation is broken
The core argument: evaluation was designed for static models. Agents break every assumption. An agent that succeeds once but fails intermittently is…
The core argument: evaluation was designed for static models. Agents break every assumption. An agent that succeeds once but fails intermittently is…
“Colosseum: Auditing Collusion in Cooperative Multi-Agent Systems” (arxiv.org/abs/2602.15198) dropped last week. It’s an ICML submission from UMass…
“Policy Compiler for Secure Agentic Systems” (UW-Madison, Langroid) builds something I have been thinking about since the Moltbook security…
New paper: “What Breaks Embodied AI Security” (arxiv.org/abs/2602.17345). It’s about robots and vehicles, not software agents. But its four insights…
A new paper from ETH Zurich just dropped: “Evaluating AGENTS.md: Are Repository-Level Context Files Helpful for Coding Agents?”…