论文

本文描述了一份以模式形式呈现的 prompt 工程技巧目录，这些技巧已被用于解决与 LLMs 对话时的常见问题，以改进 LLM 对话的输出。A catalog of prompt engineering techniques presented in pattern form that have been applied to solve common problems when conversing with LLMs to improve the outputs of LLM conversations is described.

本文旨在建立一套系统化的开放问题与应用成果清单，以便机器学习研究者更快地理解该领域的现状并开展有效工作。This paper aims to establish a systematic set of open problems and application successes so that ML researchers can comprehend the field's current state more quickly and become productive.

本综述尝试连接并系统化现有迁移学习研究，全面总结与阐释迁移学习的机制与策略，帮助读者更好地理解当前研究现状与思路。This survey attempts to connect and systematize the existing transfer learning research studies, as well as to summarize and interpret the mechanisms and the strategies of transfer learning in a comprehensive way, which may help readers have a better understanding of the current research status and ideas.

全面概述了 LLM 幻觉检测方法与基准，并指出 LLM 幻觉领域有前景的研究方向，包括大视觉-语言模型中的幻觉以及 LLM 幻觉中的知识边界理解。A thorough overview of hallucination detection methods and benchmarks is presented and the promising research directions on LLM hallucinations are highlighted, including hallucination in large vision-language models and understanding of knowledge boundaries in LLM hallucinations.

本综述旨在阐明 PFMs 在可扩展性、安全性、逻辑推理能力、跨领域学习能力以及面向 AGI 的友好交互能力方面的研究。This survey aims to shed light on the research of the PFMs on scalability, security, logical reasoning ability, cross-domain learning ability, and the user-friendly interactive ability for artificial general intelligence.

本综述对图嵌入文献进行全面回顾，并提出两种图嵌入分类法，分别对应不同图嵌入问题设置中的挑战以及现有工作如何在解决方案中应对这些挑战。This survey conducts a comprehensive review of the literature in graph embedding and proposes two taxonomies ofGraph embedding which correspond to what challenges exist in differentgraph embedding problem settings and how the existing work addresses these challenges in their solutions.

本综述从数据管理视角对数据收集进行全面研究，提供了相关操作的研究全景图、何时使用何种技术的指导原则，并识别出值得关注的研究挑战。This survey performs a comprehensive study of data collection from a data management point of view, providing a research landscape of these operations, guidelines on which technique to use when, and identify interesting research challenges.

在大规模复杂的移动边缘网络中，涉及具有不同约束的异构设备，这为大规模 FL 实施带来了通信成本、资源分配以及隐私安全方面的挑战。In a large-scale and complex mobile edge network, heterogeneous devices with varying constraints are involved, this raises challenges of communication costs, resource allocation, and privacy and security in the implementation of FL at scale.

本综述旨在通过对基本思想与关键原则的系统回顾以及对不同算法与技术的合理分类，提供在线机器学习文献的全面综述。This survey aims to provide a comprehensive survey of the online machine learning literatures through a systematic review of basic ideas and key principles and a proper categorization of different algorithms and techniques.

深入回顾文献中 GAN 相关研究，并从两个视角阐述针对三大挑战所提出的架构变体与损失变体。An in-depth review of GAN-related research in the literature is provided, and an account of the architecture-variant and loss-variants, which have been proposed to handle these three challenges from two perspectives are provided.

提出一个系统性的、以架构为中心的 LLM 记忆分类法，沿三个正交轴刻画记忆：表示、更新动态与持久性，有效桥接不同的架构范式。A systematic, architecture-centric taxonomy of memory in LLMs is presented, characterizes memory along three orthogonal axes: representation, update dynamics, and persistence, effectively bridging disparate architectural paradigms.

本 tutorial 综述近年来面向对话式 AI 的神经方法，并综述 SOTA 神经方法，揭示神经方法与传统符号方法之间的联系。This tutorial surveys neural approaches to conversational AI that were developed in the last few years, and presents a review of state-of-the-art neural approaches, drawing the connection between neural approaches and traditional symbolic approaches.

提出 ExplainBench，一个自动评估 coding agent 解释的基准，基于信息性解释应能让 LLM 正确回答问题的直觉，实现 agent 之间解释质量的量化比较。This work proposes ExplainBench, a benchmark to automatically evaluate explanations from coding agents, based on the intuition that informative explanations should enable an LLM to correctly answer questions, allowing quantitative comparison of explanation quality between agents.

对现有图神经网络模型进行了详细综述，系统性地归纳了其应用，并提出了四个有待解决的未来研究方向A detailed review over existing graph neural network models is provided, systematically categorize the applications, and four open problems for future research are proposed.

一篇全面综述，旨在深入理解 Few-shot Learning，并从三个维度对 FSL 方法进行分类：数据层面——利用先验知识扩充监督经验；模型层面——利用先验知识缩小假设空间规模；算法层面——利用先验知识改变在给定假设空间中对最优假设的搜索方式A thorough survey to fully understand Few-shot Learning and categorize FSL methods from three perspectives: data, which uses prior knowledge to augment the supervised experience; model, which uses prior knowledge to reduce the size of the hypothesis space; and algorithm, which uses prior knowledge to alter the search for the best hypothesis in the given hypothesis space.

本文对度量学习文献进行了系统综述，阐述了每种方法的优缺点，并介绍了近期涌现的一系列强大替代方法，包括非线性度量学习、相似性学习与局部度量学习。A systematic review of the metric learning literature is proposed, highlighting the pros and cons of each approach and presenting a wide range of methods that have recently emerged as powerful alternatives, including nonlinear metric learning, similarity learning and local metric learning.

该综述围绕"权重"与"技能"这一轴线组织领域，梳理了互补的"技能"一极——从无监督强化学习的技能发现，到大语言模型的技能库——并指出"skill"一词至少存在五种不同含义。This survey organises the field around that axis of weights versus skills, and maps the complementary"skills"pole, from unsupervised reinforcement-learning skill discovery to large-language-model skill libraries, and shows that the word "skill" is used in at least five distinct senses.

本文讨论了一种被称为大语言模型涌现能力的不可预测现象——若某项能力在小模型中不存在而在大模型中存在，则称为涌现。This paper discusses an unpredictable phenomenon that is referred to as emergent abilities of large language models, an ability to be emergent if it is not present in smaller models but is present in larger models.

本文针对 OOD 检测领域的近期技术发展空白，提出统一框架 generalized OOD detection（广义 OOD 检测），涵盖上述五类问题，即 AD、ND、OSR、OOD detection 与 OD。This paper addresses the gap in recent technical developments in recent technical developments in the field of OOD detection by presenting a unified framework called generalized OOD detection, which encompasses the five aforementioned problems, i.e.,AD, ND, OSR, OOD detection, and OD.

综述领域自适应与迁移学习，重点关注视觉应用及超越图像分类的方法，如目标检测、图像分割、视频分析或视觉属性学习。An overview of domain adaptation and transfer learning with a specific view on visual applications and the methods that go beyond image categorization, such as object detection or image segmentation, video analyses or learning visual attributes are overviewed.

本文给出 ICL 的形式化定义，厘清其与相关研究的联系，并梳理讨论训练策略、提示设计策略及相关分析等高级技术。This paper presents a formal definition of ICL and clarify its correlation to related studies, and organizes and discusses advanced techniques, including training strategies, prompt designing strategies, and related analysis.

从算法建模、应用和理论分析角度对 MTL 的综述，给出了 MTL 的定义，并将不同 MTL 算法分为五类：特征学习方法、低秩方法、任务聚类方法、任务关系学习方法和分解方法A survey for MTL from the perspective of algorithmic modeling, applications and theoretical analyses, which gives a definition of MTL and classify different MTL algorithms into five categories, including feature learning approach, low-rank approach, task clustering approach,task relation learning approach and decomposition approach.

较为全面地列举了基于群体智能、生物启发、物理启发和化学启发（按灵感来源分类）的所有算法，这些算法已成为解决实际问题的流行工具A relatively comprehensive list of all the algorithms based on swarm intelligence, bio-inspired, physics-based and chemistry-based, depending on the sources of inspiration, that have become popular tools for solving real-world problems.

本文报告了一项完整的、有完整记录的案例研究：在规范优先协议下，由 AI 编码 Agent 对大规模架构进行重构，期间无人工代码审查、无预先存在的预言机来验证目标行为。该任务是在一个大型相互依赖的代码库中拆除核心不变量，作者评估认为通过增量重构基本上不可行，这类变更通常需要重写。本文所述协议下，Agent 成功完成了任务。该系统包含 717,725 行This paper reports a single, fully instrumented case study of a large-scale architectural refactoring by an AI coding agent under a specification-first protocol, with no human review of the generated code and no pre-existing oracle to validate the target behaviour. The task, dismantling a central invariant across a large interdependent codebase, was assessed by the author as effectively infeasible through incremental refactoring, the kind of change that conventionally calls for a rewrite instead. Under the protocol described here, the agent completed it successfully. The system is a 717,725-li