论文

本文回顾现有方法，并融合多种技术从数据与模型规模两方面扩展预训练，提出一条自动化流水线以构建专用、多样且经过筛选的图像数据集，替代自监督文献中常用的未筛选数据。This work revisits existing approaches and combines different techniques to scale the pretraining in terms of data and model size, and proposes an automatic pipeline to build a dedicated, diverse, and curated image dataset instead of uncurated data, as typically done in the self-supervised literature.

一种面向语言模型推理的新框架 Tree of Thoughts (ToT)，推广了流行的 Chain of Thought 提示方法，允许在作为问题求解中间步骤的连贯文本单元（thoughts）上进行探索。A new framework for language model inference, Tree of Thoughts (ToT), which generalizes over the popular Chain of Thought approach to prompting language models, and enables exploration over coherent units of text (thoughts) that serve as intermediate steps toward problem solving.

本文推出 ScanNet，一个 RGB-D 视频数据集，包含 1513 个场景中的 250 万视角，标注有三维相机位姿、表面重建与语义分割，并表明使用该数据可在多项三维场景理解任务上取得 SOTA 性能。This work introduces ScanNet, an RGB-D video dataset containing 2.5M views in 1513 scenes annotated with 3D camera poses, surface reconstructions, and semantic segmentations, and shows that using this data helps achieve state-of-the-art performance on several 3D scene understanding tasks.

本文提出 Toolformer，训练其决定调用哪些 API、何时调用、传入什么参数，以及如何将结果最佳地融入后续 token 预测，在多种下游任务上显著提升零样本性能。This paper introduces Toolformer, a model trained to decide which APIs to call, when to call them, what arguments to pass, and how to best incorporate the results into future token prediction, which achieves substantially improved zero-shot performance across a variety of downstream tasks.

本文介绍 Matterport3D，一个大规模 RGB-D 数据集，包含来自 90 个建筑物级场景共 194,400 张 RGB-D 图像的 10,800 个全景视图，可支持多种监督与自监督计算机视觉任务，包括关键点匹配、视角重叠预测、由彩色图像预测法线、语义分割和区域分类。Matterport3D is introduced, a large-scale RGB-D dataset containing 10,800 panoramic views from 194,400RGB-D images of 90 building-scale scenes that enable a variety of supervised and self-supervised computer vision tasks, including keypoint matching, view overlap prediction, normal prediction from color, semantic segmentation, and region classification.

本文对上述解决方案进行了详细综述，总结了其技术创新与实验结果，比较了各方法的优势与适用条件，并给出推荐方案。This article provides a detailed review of the solutions above, summarizing both the technical novelties and empirical results, and compares the benefits and requirements of the surveyed methodologies and provides recommended solutions.

本文详细介绍了 CNN 在多个方面的改进，包括层设计、激活函数、损失函数、正则化、优化与快速计算，并阐述了卷积神经网络在计算机视觉、语音与自然语言处理中的多种应用。This paper details the improvements of CNN on different aspects, including layer design, activation function, loss function, regularization, optimization and fast computation, and introduces various applications of convolutional neural networks in computer vision, speech and natural language processing.

提出 BERTopic，一种通过开发类内 TF-IDF 变体来提取一致性主题表示，从而扩展主题建模流程的主题模型BERTopic is presented, a topic model that extends the process of topic modeling by extracting coherent topic representation through the development of a class-based variation of TF-IDF.

提出一种从校正后的图像对中提取深度信息的方法，使用卷积神经网络在小图像块上学习相似性度量，并针对该任务考察了两种网络架构：一种面向速度优化，另一种面向精度优化This work presents a method for extracting depth information from a rectified image pair by learning a similarity measure on small image patches using a convolutional neural network and examines two network architectures for this task: one tuned for speed, the other for accuracy.

一篇全面综述，旨在深入理解 Few-shot Learning，并从三个维度对 FSL 方法进行分类：数据层面——利用先验知识扩充监督经验；模型层面——利用先验知识缩小假设空间规模；算法层面——利用先验知识改变在给定假设空间中对最优假设的搜索方式A thorough survey to fully understand Few-shot Learning and categorize FSL methods from three perspectives: data, which uses prior knowledge to augment the supervised experience; model, which uses prior knowledge to reduce the size of the hypothesis space; and algorithm, which uses prior knowledge to alter the search for the best hypothesis in the given hypothesis space.

在训练过程中，Random Erasing 在图像中随机选择一个矩形区域并以随机值擦除其像素，在图像分类、目标检测与行人重识别任务中相较于强基线均带来稳定提升In training, Random Erasing randomly selects a rectangle region in an image and erases its pixels with random values and yields consistent improvement over strong baselines in image classification, object detection and person re-identification.

简化了 MoE 路由算法，设计出通信与计算成本更低的直观改进模型，并首次证明大型稀疏模型可以使用更低精度格式进行训练This work simplifies the MoE routing algorithm and design intuitive improved models with reduced communication and computational costs and shows large sparse models may be trained, for the first time, with lower precision formats.

Pointer sentinel-LSTM 模型在 Penn Treebank 上以远少于标准 softmax LSTM 的参数量达到 SOTA 语言建模性能，并开源了 WikiText 语料库The pointer sentinel-LSTM model achieves state of the art language modeling performance on the Penn Treebank while using far fewer parameters than a standard softmax LSTM and the freely available WikiText corpus is introduced.

论文证明，使用标注数据进行微调，并允许模型查询外部知识源，能够在安全性和事实性这两个关键挑战上带来显著提升。It is demonstrated that fine-tuning with annotated data and enabling the model to consult external knowledge sources can lead to significant improvements towards the two key challenges of safety and factual grounding.

本文讨论了一种被称为大语言模型涌现能力的不可预测现象——若某项能力在小模型中不存在而在大模型中存在，则称为涌现。This paper discusses an unpredictable phenomenon that is referred to as emergent abilities of large language models, an ability to be emergent if it is not present in smaller models but is present in larger models.

一个仅依赖字符级输入的简单神经语言模型，仅从字符即可编码语义和正字法信息，表明在许多语言中，字符输入足以完成语言建模。A simple neural language model that relies only on character-level inputs that is able to encode, from characters only, both semantic and orthographic information and suggests that on many languages, character inputs are sufficient for language modeling.

本工作训练了一个预测的计算最优模型 Chinchilla，使用与 Gopher 相同的计算预算，但参数量为 70B、数据量为 4 倍，达到 SOTA 平均准确率，比 Gopher 提升超过 7%。This work trains a predicted compute-optimal model, Chinchilla, that uses the same compute budget as Gopher but with 70B parameters and 4$\times$ more more data, and reaches a state-of-the-art average accuracy, greater than a 7% improvement over Gopher.

本工作综述了可用于推断用户需求的贝叶斯用户模型研究，这些模型综合考虑用户的背景、操作和查询，并提出了一种智能用户界面的整体架构。This work reviews work on Bayesian user models that can be employed to infer a user's needs by considering a users' background, actions, and queries and proposes an overall architecture for an intelligent user interface.

探索以交错方式使用 LLM 同时生成推理轨迹和任务特定动作，使两者产生更大协同：推理轨迹帮助模型归纳、跟踪和更新动作计划以及处理异常，而动作使其与外部源交互以获取额外信息。The use of LLMs are explored to generate both reasoning traces and task-specific actions in an interleaved manner, allowing for greater synergy between the two: reasoning traces help the model induce, track, and update action plans as well as handle exceptions, while actions allow it to interface with external sources to gather additional information.