arXiv:2609.10539 · 评测基准
IdeaAMBIG: Benchmarking Implementation-Critical Gaps in Research-Idea Specifications
IdeaAMBIG：研究构想规范中面向实现的关键缺口基准
IdeaAMBIG: Benchmarking Implementation-Critical Gaps in Research-Idea Specifications
- 类型：arxiv
- 标识：2609.10539
- 链接：https://arxiv.org/abs/2609.10539
- 主分类：evaluation
- 形态：benchmark
- TLDR：A research idea may be novel, coherent, and scientifically plausible, yet its proposed method may remain insufficiently specified for faithful implementation. We study the codification readiness of implementation-facing research-method specifications, defined by whether they provide sufficient methodological information for a competent implementer or coding agent to construct the intended method without unsupported assumptions. We construct evidence-grounded specifications and their supported resolutions from papers, codebases, issue threads, and reproduction artifacts. We introduce IdeaAMBIG,
- 待LLM分类：否
- 标题中文：IdeaAMBIG：研究构想规范中面向实现的关键缺口基准
- TLDR中文：一个研究构想可能新颖、连贯且科学合理，但其方法仍可能因细节不足而难以忠实实现。我们研究面向实现的研究方法规范的编码就绪度，定义为是否提供足够的方法学信息，使称职的实现者或编码 Agent 能在无未支持假设的前提下构建目标方法。我们基于论文、代码库、issue 讨论与复现工件构建了基于证据的规范及其支持性消解方案。我们提出 IdeaAMBIG…
- 来源文件：
- /inbox/tom/_candidates/2026-09-12-agent-rag-longcontext-candidates.json