UndoBench: Separating Task Competence from Recovery Capability in Tool-Using AI Agents
- 类型：arxiv
- 标识：2610.05622
- 链接：https://arxiv.org/abs/2610.05622
- 主分类：agent
- 形态：benchmark
- TLDR：Tool-using AI agents are increasingly deployed across enterprise software systems, yet widely used benchmarks primarily evaluate nominal task completion, conflating baseline planning competence with operational fault recovery. We introduce UndoBench, a benchmark spanning 36 base workflows and 36 fault scenarios across 8 enterprise domains, decoupling task competence from recovery capability via counterfactual paired trials under identical seeds alongside wire-level effect-history and environment-state oracles. On 12 held-out TEST workflows across two open-weight models, two frameworks, and thr
- 副分类：evaluation
- 待LLM分类：否
- 来源文件：
- /inbox/tom/_candidates/2026-10-06-agent-rag-longcontext-candidates.json