DocOps: A Verifiable Benchmark for Autonomous Agents in Complex Document Operations
- 类型:arxiv
- 标识:2607.19865
- 链接:https://arxiv.org/abs/2607.19865
- 主分类:evaluation
- 形态:benchmark
- 被引:1
- 被引来源:Semantic Scholar
- S2被引:1
- OpenAlex被引:0
- 影响力被引:0
- TLDR:DocOps is introduced, a deterministically verifiable evaluation framework underpinned by a hierarchical taxonomy that deconstructs document operations inspired by real-world practices into atomic dimensions and escalating workflow complexities that exposes the capability boundaries of agents in maintaining global document consistency.
- OpenAlex ID:W7170180645
- OpenAlex DOI:10.48550/arxiv.2607.19865
- DOI:10.48550/arxiv.2607.19865
- DOI来源:OpenAlex
- 开放获取:green
- 开放获取链接:https://doi.org/10.48550/arxiv.2607.19865
- OpenAlex更新:2026-08-24
- 副分类:agent
- 待LLM分类:否
- 标题中文:DocOps:面向复杂文档操作的自主 Agent 可验证基准
- TLDR中文:提出 DocOps,一种确定性可验证的评估框架,基于分层分类法,将受真实实践启发的文档操作分解为原子维度与逐级递增的工作流复杂度,从而揭示 Agent 在维护全局文档一致性方面的能力边界。
- 来源文件:
- /inbox/tom/_candidates/2026-07-23-agent-rag-longcontext-candidates.json
- /inbox/tom/_candidates/2026-07-24-agent-rag-longcontext-candidates.json
- [S2 enrich]
- [OpenAlex backfill]