Papers · organized/paper_cards

论文

115 张论文卡片 · 评测集 · OA 绿色

开放获取 全部 绿色 · 724
See2Think: Do Multimodal Models Really Use Intermediate Visual States?
See2Think:多模态模型真的使用了中间视觉状态吗?
arXiv:2607.26769 多模态 评测集 OA · 绿色 被引 0 · S2 + OpenAlex

对代表性闭源与开源多模态模型的评测表明,视觉推理强依赖于模型与环境,没有任何单一设置能在所有任务上持续占优。Evaluating representative proprietary and open-source multimodal models, it is found that visual reasoning is strongly model- and environment-dependent, with no single setting consistently dominating across tasks.

Educating the Agentic Engineer: Curricula, Collaboration, and Continuous Learning in the AI Era
培养 Agentic 工程师:AI 时代的课程、协作与持续学习
arXiv:2607.29610 Agent 智能体 评测集 OA · 绿色 被引 0 · S2 + OpenAlex

教育agentic工程师需要系统性变革而非增量式课程改革:教学必须从产出工件转向对日益自主的社会-技术系统进行判断。It is concluded that educating the agentic engineer requires systemic transformation rather than incremental curricular change: instruction must shift from producing artifacts to exercising judgment over increasingly autonomous socio-technical systems.

ExtractBench: A Benchmark for Schema-Guided Enterprise Document Extraction
ExtractBench:一个面向模式引导的企业文档抽取基准
arXiv:2607.29677 评测基准 评测集 OA · 绿色 被引 1 · S2

LlamaExtract Agentic Plus在三项指标上均排名第一,准确度可与coding agent相媲美而成本仅为其一小部分,是首个同时在大规模下对数值准确性、记录完整性、grounding与实测成本进行打分的方法。LlamaExtract Agentic Plus ranks first on all three metrics, with accuracy comparable to coding agents at a fraction of the cost, and is the first to score value accuracy, record completeness at scale, grounding, and measured cost together.

Fewer Clarifications, Better Code: Benchmarking Cross-Session Personalized Ambiguity Adaptation in Coding Assistants
更少澄清,更优代码:面向编程助手的跨会话个性化歧义自适应基准测试
arXiv:2607.26611 评测基准 评测集 OA · 绿色 被引 0 · S2 + OpenAlex

CAPA通过六种机制刻画个性化编码歧义,并使用受控的三阶段生成流程将这些机制注入无歧义的可执行任务,为开发长期编码助手奠定基础,使其生成的代码更好地对齐用户意图并减少反复澄清。CAPA, which characterizes personalized coding ambiguity through six mechanisms and injects these mechanisms into unambiguous executable tasks using a controlled three-stage generation pipeline, provides a foundation for developing long-term coding assistants that better align generated code with user intent while reducing repeated clarification.

CodeXGLUE: A Machine Learning Benchmark Dataset for Code Understanding and Generation
CodeXGLUE:面向代码理解与生成的机器学习基准数据集
arXiv:2102.04664 评测基准 评测集 OA · 绿色 被引 1578 · S2

本文介绍了 CodeXGLUE,一个基准数据集,旨在推动面向程序理解与生成的机器学习研究,涵盖 14 个数据集上的 10 项任务,并提供模型评估与比较的平台。This paper introduces CodeXGLUE, a benchmark dataset to foster machine learning research for program understanding and generation that includes a collection of 10 tasks across 14 datasets and a platform for model evaluation and comparison.

The Natural Language Decathlon: Multitask Learning as Question Answering
自然语言十项全能:将多任务学习视为问答
arXiv:1806.08730 评测基准 评测集 OA · 绿色 被引 666 · S2

于 2018 年 8 月 28 日中午 12:15 在 Pettit 微电子研究中心 102 A/B 室进行报告。Presented on August 28, 2018 at 12:15 p.m. in the Pettit Microelectronics Research Center, Room 102 A/B.

Solving Quantitative Reasoning Problems with Language Models
用语言模型解决定量推理问题
arXiv:2206.14858 评测基准 评测集 OA · 绿色 被引 1919 · S2