论文

本文对 LLM agent 评估这一新兴领域进行了深入综述，提出一个二维分类体系，沿评估目标维度组织已有工作，为系统性评估提供框架，使研究者与从业者能够面向真实场景部署评估 LLM agent。An in-depth overview of the emerging field of LLM agent evaluation is provided, introducing a two-dimensional taxonomy that organizes existing work along evaluation objectives and provides a framework for systematic assessment, enabling researchers and practitioners to evaluate LLM agents for real-world deployment.

本综述系统梳理了超越基础 Skill 创建的 Skill 演化与评估图景，将其归纳为四种范式：执行反馈、轨迹蒸馏、压缩与强化学习，并指出了构建可泛化、高效且可验证安全的 Skill 生态的开放方向。This survey systematically examines the landscape of skill evolution and evaluation beyond foundational skill creation into four distinct paradigms, spanning execution feedback, trajectory distillation, compression, and reinforcement learning, and identifies open directions for building skill ecosystems that are generalizable, efficient, and verifiably safe.

以人为本的智能正在基础模型时代演进，越来越强调规模、可迁移性与通用建模。然而，它尚未与基础模型充分融合以取得可比拟的进展。更重要的是，这一广阔领域的近期进展仍分散在不同任务、模态与研究社区之间，其内在的概念与方法学联系尚不清晰。为弥合这些分歧并重新思考基础模型时代的以人为本智能，我们提出一套全谱系的人类上下文分类法Human-centric intelligence is evolving in the foundation-model era, with growing emphasis on scale, transferability, and general-purpose modeling. Yet it has not fully integrated with foundation models to achieve the comparable progress seen in them. More importantly, recent advances across this broad landscape remain fragmented across tasks, modalities, and research communities, leaving their intrinsic conceptual and methodological connections unclear. To bridge these divides and rethink human-centric intelligence in the foundation-model era, we introduce a full-spectrum human context taxonom

本文聚焦 LLM 驱动的 kernel generation 领域，给出现有方法的结构化综述，涵盖 LLM-based 方法与 agentic optimization workflow，并系统梳理了支撑该领域学习与评测的数据集与 benchmark。This survey addresses the gap in LLM-driven kernel generation by providing a structured overview of existing approaches, spanning LLM-based approaches and agentic optimization workflows, and systematically organizing the datasets and benchmarks that underpin learning and evaluation in this domain.

研究发现重建质量与表示质量是解耦的；在所考察的任务中，没有任何单一方法能够在所有任务上稳定取得最优表现。It is found that reconstruction and representation quality are decoupled, and no single method consistently performs best across the tasks considered here and no single method consistently performs best across the tasks considered here.

本文对 LLM 的评估方法进行了全面综述，围绕三个关键维度展开：评估什么、在何处评估、如何评估，并为 LLM 评估领域的研究者提供了宝贵洞见。This paper presents a comprehensive review of these evaluation methods for LLMs, focusing on three key dimensions: what to evaluate, where to evaluate, and how to evaluate, and offers invaluable insights to researchers in the realm of LLMs evaluation.

本文针对 OOD 检测领域的近期技术发展空白，提出统一框架 generalized OOD detection（广义 OOD 检测），涵盖上述五类问题，即 AD、ND、OSR、OOD detection 与 OD。This paper addresses the gap in recent technical developments in recent technical developments in the field of OOD detection by presenting a unified framework called generalized OOD detection, which encompasses the five aforementioned problems, i.e.,AD, ND, OSR, OOD detection, and OD.