Papers · organized/paper_cards

论文

5 张论文卡片 · 评测基准 · 综述 · OA 绿色

开放获取 全部 绿色 · 724
🔴 保留 · `Agent Skill Evaluation and Evolution: Frameworks and Benchmarks`
🔴 保留 · `Agent Skill Evaluation and Evolution: Frameworks and Benchmarks`
arXiv:2606.11435 评测基准 综述 OA · 绿色 被引 3 · S2

本综述系统梳理了超越基础 Skill 创建的 Skill 演化与评估图景,将其归纳为四种范式:执行反馈、轨迹蒸馏、压缩与强化学习,并指出了构建可泛化、高效且可验证安全的 Skill 生态的开放方向。This survey systematically examines the landscape of skill evolution and evaluation beyond foundational skill creation into four distinct paradigms, spanning execution feedback, trajectory distillation, compression, and reinforcement learning, and identifies open directions for building skill ecosystems that are generalizable, efficient, and verifiably safe.

2️⃣ arXiv · "Towards Automated Kernel Generation in the Era of LLMs"(Survey)
arXiv · "Towards Automated Kernel Generation in the Era of LLMs"(Survey)⭐⭐⭐⭐
arXiv:2601.15727 评测基准 综述 OA · 绿色 被引 8 · S2

本文聚焦 LLM 驱动的 kernel generation 领域,给出现有方法的结构化综述,涵盖 LLM-based 方法与 agentic optimization workflow,并系统梳理了支撑该领域学习与评测的数据集与 benchmark。This survey addresses the gap in LLM-driven kernel generation by providing a structured overview of existing approaches, spanning LLM-based approaches and agentic optimization workflows, and systematically organizing the datasets and benchmarks that underpin learning and evaluation in this domain.

The Galaxy's Guide to the Tokenizer: A Benchmark for Scientific Foundation Models
The Galaxy's Guide to the Tokenizer: A Benchmark for Scientific Foundation Models
arXiv:2606.25610 评测基准 综述 OA · 绿色 被引 0 · S2 + OpenAlex

研究发现重建质量与表示质量是解耦的;在所考察的任务中,没有任何单一方法能够在所有任务上稳定取得最优表现。It is found that reconstruction and representation quality are decoupled, and no single method consistently performs best across the tasks considered here and no single method consistently performs best across the tasks considered here.

A Survey on Evaluation of Large Language Models
大语言模型评估综述
arXiv:2307.03109 评测基准 综述 OA · 绿色 被引 3721 · S2

本文对 LLM 的评估方法进行了全面综述,围绕三个关键维度展开:评估什么、在何处评估、如何评估,并为 LLM 评估领域的研究者提供了宝贵洞见。This paper presents a comprehensive review of these evaluation methods for LLMs, focusing on three key dimensions: what to evaluate, where to evaluate, and how to evaluate, and offers invaluable insights to researchers in the realm of LLMs evaluation.

Generalized Out-of-Distribution Detection: A Survey
广义分布外检测:综述
arXiv:2110.11334 评测基准 综述 OA · 绿色 被引 1506 · S2

本文针对 OOD 检测领域的近期技术发展空白,提出统一框架 generalized OOD detection(广义 OOD 检测),涵盖上述五类问题,即 AD、ND、OSR、OOD detection 与 OD。This paper addresses the gap in recent technical developments in recent technical developments in the field of OOD detection by presenting a unified framework called generalized OOD detection, which encompasses the five aforementioned problems, i.e.,AD, ND, OSR, OOD detection, and OD.