APort Vault: Benchmarking AI Agent Payment Authorization with the Open Agent Passport
- 类型:arxiv
- 标识:2609.22076
- 链接:https://arxiv.org/abs/2609.22076
- 主分类:agent
- 形态:benchmark
- TLDR:APort Vault is a benchmark for payment authorization in tool-using AI agents. It replays 4,371 attacks written by humans against a live payment agent during a public capture-the-flag event, across 14 models from 8 labs, five policy configurations and two replay tracks, with and without a deterministic pre-action check implementing the Open Agent Passport (OAP) specification. 225,964 evaluations completed. We report five distinct events per evaluation, because collapsing them is how an agent benchmark produces a number that does not survive review. Requests are common and their rate differs far
- 副分类:evaluation
- 待LLM分类:否
- 标题中文:APort Vault:基于 Open Agent Passport 的 AI Agent 支付授权基准
- TLDR中文:APort Vault 是面向工具使用 AI Agent 支付授权的基准。它在公开 CTF 活动中重放了人类编写的 4,371 次针对真实支付 Agent 的攻击,覆盖 8 家实验室的 14 个模型、五种策略配置与两条重放轨道,每条轨道分别在有/无确定性的 pre-action check(实现 Open Agent Passport (OAP) 规范)下执行,共计完成 225,964 次评测。我们每次评测报告五个独立事件,因为将它们合并正是 Agent 基准产生无法经得起审查的数字的方式。请求很常见,且其速率差异巨大
- 来源文件:
- /inbox/tom/_candidates/2026-09-21-agent-rag-longcontext-candidates.json