本文对 LLM agent 评估这一新兴领域进行了深入综述,提出一个二维分类体系,沿评估目标维度组织已有工作,为系统性评估提供框架,使研究者与从业者能够面向真实场景部署评估 LLM agent。An in-depth overview of the emerging field of LLM agent evaluation is provided, introducing a two-dimensional taxonomy that organizes existing work along evaluation objectives and provides a framework for systematic assessment, enabling researchers and practitioners to evaluate LLM agents for real-world deployment.
论文
2 张论文卡片 · 评测基准 · 综述
6. Evaluation and Benchmarking of LLM Agents: A Survey
LLM Agent 的评估与基准测试:综述
🔴 保留 · `Agent Skill Evaluation and Evolution: Frameworks and Benchmarks`
🔴 保留 · `Agent Skill Evaluation and Evolution: Frameworks and Benchmarks`
本综述系统梳理了超越基础 Skill 创建的 Skill 演化与评估图景,将其归纳为四种范式:执行反馈、轨迹蒸馏、压缩与强化学习,并指出了构建可泛化、高效且可验证安全的 Skill 生态的开放方向。This survey systematically examines the landscape of skill evolution and evaluation beyond foundational skill creation into four distinct paradigms, spanning execution feedback, trajectory distillation, compression, and reinforcement learning, and identifies open directions for building skill ecosystems that are generalizable, efficient, and verifiably safe.