本文对 LLM agent 评估这一新兴领域进行了深入综述,提出一个二维分类体系,沿评估目标维度组织已有工作,为系统性评估提供框架,使研究者与从业者能够面向真实场景部署评估 LLM agent。An in-depth overview of the emerging field of LLM agent evaluation is provided, introducing a two-dimensional taxonomy that organizes existing work along evaluation objectives and provides a framework for systematic assessment, enabling researchers and practitioners to evaluate LLM agents for real-world deployment.
论文
3 张论文卡片 · 评测基准 · 综述
本综述系统梳理了超越基础 Skill 创建的 Skill 演化与评估图景,将其归纳为四种范式:执行反馈、轨迹蒸馏、压缩与强化学习,并指出了构建可泛化、高效且可验证安全的 Skill 生态的开放方向。This survey systematically examines the landscape of skill evolution and evaluation beyond foundational skill creation into four distinct paradigms, spanning execution feedback, trajectory distillation, compression, and reinforcement learning, and identifies open directions for building skill ecosystems that are generalizable, efficient, and verifiably safe.
本文针对 OOD 检测领域的近期技术发展空白,提出统一框架 generalized OOD detection(广义 OOD 检测),涵盖上述五类问题,即 AD、ND、OSR、OOD detection 与 OD。This paper addresses the gap in recent technical developments in recent technical developments in the field of OOD detection by presenting a unified framework called generalized OOD detection, which encompasses the five aforementioned problems, i.e.,AD, ND, OSR, OOD detection, and OD.