研究库 论文知识库
Papers · organized/paper_cards

论文

188 张论文卡片 · 工程化 · OA 绿色

开放获取 全部 绿色 · 1640
Graph Neural Networks: A Review of Methods and Applications
图神经网络:方法与应用综述
arXiv:1812.08434 工程化 综述 OA · 绿色 被引 7460 · S2

对现有图神经网络模型进行了详细综述,系统性地归纳了其应用,并提出了四个有待解决的未来研究方向A detailed review over existing graph neural network models is provided, systematically categorize the applications, and four open problems for future research are proposed.

BERTopic: Neural topic modeling with a class-based TF-IDF procedure
BERTopic:基于类内 TF-IDF 流程的神经主题建模
arXiv:2203.05794 工程化 方法 OA · 绿色 被引 3220 · S2

提出 BERTopic,一种通过开发类内 TF-IDF 变体来提取一致性主题表示,从而扩展主题建模流程的主题模型BERTopic is presented, a topic model that extends the process of topic modeling by extracting coherent topic representation through the development of a class-based variation of TF-IDF.

Stereo Matching by Training a Convolutional Neural Network to Compare Image Patches
通过训练卷积神经网络比较图像块进行立体匹配
arXiv:1510.05970 工程化 方法 OA · 绿色 被引 1478 · S2

提出一种从校正后的图像对中提取深度信息的方法,使用卷积神经网络在小图像块上学习相似性度量,并针对该任务考察了两种网络架构:一种面向速度优化,另一种面向精度优化This work presents a method for extracting depth information from a rectified image pair by learning a similarity measure on small image patches using a convolutional neural network and examines two network architectures for this task: one tuned for speed, the other for accuracy.

Generalizing from a Few Examples: A Survey on Few-Shot Learning
基于少量样本的泛化:小样本学习综述
arXiv:1904.05046 工程化 综述 OA · 绿色 被引 2213 · S2

一篇全面综述,旨在深入理解 Few-shot Learning,并从三个维度对 FSL 方法进行分类:数据层面——利用先验知识扩充监督经验;模型层面——利用先验知识缩小假设空间规模;算法层面——利用先验知识改变在给定假设空间中对最优假设的搜索方式A thorough survey to fully understand Few-shot Learning and categorize FSL methods from three perspectives: data, which uses prior knowledge to augment the supervised experience; model, which uses prior knowledge to reduce the size of the hypothesis space; and algorithm, which uses prior knowledge to alter the search for the best hypothesis in the given hypothesis space.

Random Erasing Data Augmentation
Random Erasing 数据增强
arXiv:1708.04896 工程化 方法 OA · 绿色 被引 4339 · S2

在训练过程中,Random Erasing 在图像中随机选择一个矩形区域并以随机值擦除其像素,在图像分类、目标检测与行人重识别任务中相较于强基线均带来稳定提升In training, Random Erasing randomly selects a rectangle region in an image and erases its pixels with random values and yields consistent improvement over strong baselines in image classification, object detection and person re-identification.

When Many Answers Are Valid, Voting Fails: Symbolic Verification for Best-of-K Causal Reasoning in LLMs
当多个答案均有效时,投票失效:面向 LLM Best-of-K 因果推理的符号验证
arXiv:2608.03506 工程化 方法 OA · 绿色 被引 0 · S2 + OpenAlex

提出 CALVER (Causal Axiom-Level VERification),一种无需训练的对称验证器,根据 Pearl 的因果准则(包括 d-分离、backdoor 调整与干预)对结构化 trace 评分,并在不参考标准答案的情况下选择得分最高的候选。This work introduces CALVER (Causal Axiom-Level VERification), a training-free symbolic verifier that scores structured traces against Pearl's causal criteria, including -separation, backdoor adjustment, and intervention, and selects the highest-scoring candidate without consulting a reference answer.

ReflectRL: Learning from Golden Negative Trajectories via Reflective-to-Direct Reasoning
ReflectRL: 通过反思到直接推理从 Golden Negative Trajectories 中学习
arXiv:2608.03972 工程化 方法 OA · 绿色 被引 5 · S2

提出 ReflectRL,一个轻量级即插即用框架,在 on-policy 训练中从 Golden Negative Trajectories 中学习:先利用这些 trajectory 引出 Reflective Reasoning,再通过 Reflective-to-Direct Policy Transition 将所学到的推理行为迁移回 Direct Reasoning。ReflectRL is proposed, a lightweight plug-and-play framework that learns from Golden Negative Trajectories during on-policy training, and first uses these trajectories to elicit Reflective Reasoning, then applies Reflective-to-Direct Policy Transition to transfer the acquired reasoning behavior back to Direct Reasoning.

K-EXAONE 2.0 Technical Report
K-EXAONE 2.0 技术报告
arXiv:2608.04505 工程化 方法 OA · 绿色 被引 0 · S2 + OpenAlex

K-EXAONE 2.0 在 K-EXAONE 基础上进一步提升,并保持与开源权重模型的竞争力,其最大提升体现在 agentic coding 与长上下文理解上,在长上下文检索与安全性方面优势最为明显。K-EXAONE 2.0 improves over K-EXAONE and remains competitive with open-weight models, showing its largest gains in agentic coding and long-context understanding and its clearest strengths in long-context retrieval and safety.

MultiPathFormer: Towards a Foundation Model for Multipath Wireless Propagation
MultiPathFormer:迈向多径无线传播的基础模型
arXiv:2608.05076 工程化 方法 OA · 绿色 被引 0 · S2 + OpenAlex

提出 MultiPathFormer,一种自回归基础模型,将每条发射端–接收端链路表示为连续值路径 token 的有序序列,并通过下一路径预测进行预训练,证明路径级预训练可学习无线传播的可复用表征。MultiPathFormer, an autoregressive foundation model that represents each transmitter-receiver link as an ordered sequence of continuous-valued path tokens and pretrains with next-path prediction, is presented, showing that path-level pretraining can learn reusable representations of wireless propagation.

Ego2Robot: Scalable Robot Data Synthesis from Egocentric Human Data
Ego2Robot:从第一人称人类数据出发的可扩展机器人数据合成
arXiv:2608.02580 工程化 方法 OA · 绿色 被引 13 · S2

实验表明,在 Ego2Robot 合成数据与机器人数据上的联合预训练在多种扰动类型上一致提升分布外泛化能力,并在真实机器人部署中得到验证。Experiments show that joint pretraining on Ego2Robot-synthesized and robot data consistently improves out-of-distribution generalization across multiple perturbation types, with benefits validated on real-robot deployment.

BEiT: BERT Pre-Training of Image Transformers
BEiT: 图像 Transformers 的 BERT 预训练
arXiv:2106.08254 工程化 方法 OA · 绿色 被引 3948 · S2

文章介绍了一种自监督视觉表征模型 BEiT(Bidirectional Encoder representation from Image Transformers),在图像分类和语义分割上的结果表明,该模型取得了与先前预训练方法相当的竞争性结果。A self-supervised vision representation model BEiT, which stands for Bidirectional Encoder representation from Image Transformers, is introduced, and results on image classification and semantic segmentation show that the model achieves competitive results with previous pre-training methods.

A Survey on Metric Learning for Feature Vectors and Structured Data
面向特征向量与结构化数据的度量学习综述
arXiv:1306.6709 工程化 综述 OA · 绿色 被引 720 · S2

本文对度量学习文献进行了系统综述,阐述了每种方法的优缺点,并介绍了近期涌现的一系列强大替代方法,包括非线性度量学习、相似性学习与局部度量学习。A systematic review of the metric learning literature is proposed, highlighting the pros and cons of each approach and presenting a wide range of methods that have recently emerged as powerful alternatives, including nonlinear metric learning, similarity learning and local metric learning.

Multi-Task Learning Using Uncertainty to Weigh Losses for Scene Geometry and Semantics
利用不确定性为损失加权的多任务学习,用于场景几何与语义
arXiv:1705.07115 工程化 方法 OA · 绿色 被引 4552 · S2

本文提出一种多任务深度学习的原则性方法,通过考虑各任务的同方差不确定性来加权多个损失函数,从而在分类与回归场景下同时学习具有不同单位或尺度的多种量。A principled approach to multi-task deep learning is proposed which weighs multiple loss functions by considering the homoscedastic uncertainty of each task, allowing us to simultaneously learn various quantities with different units or scales in both classification and regression settings.

Lossless Tensor Compression as Program Synthesis
将无损张量压缩视为程序合成
arXiv:2608.02162 工程化 应用落地 OA · 绿色 被引 1 · S2

设计了一种类型化的领域特定语言(DSL),通过一组可逆算子捕获重复区域、浮点域等常见张量结构,将无损张量压缩建模为程序合成问题。A typed domain-specific language that captures recurring tensor structures, such as repeated regions and floating-point fields, through a set of reversible operators, is designed, which formulates lossless tensor compression as program synthesis.

Continual Learning in Transition
转型中的持续学习
arXiv:2608.06216 工程化 方法 OA · 绿色 被引 0 · S2 + OpenAlex

基于该三轴框架,系统梳理代表性方法,追踪持续学习的演进趋势,并讨论由此引发的关键挑战、更广泛的影响以及未来方向。Anchored by this tri-axial framework, representative methods are systematically surveyed, the ongoing transition of continual learning is traced, and the key challenges, broader implications, and future directions arising from this paradigm shift are discussed.

Training language models to follow instructions with human feedback
使用人类反馈训练语言模型遵循指令
arXiv:2203.02155 工程化 方法 OA · 绿色 被引 24834 · S2

结果表明,使用人类反馈进行微调是使语言模型与人类意图对齐的一个有前景的方向,在真实性方面有所提升,并减少了有毒输出的生成,同时在公开 NLP 数据集上的性能回归极小。The results show that fine-tuning with human feedback is a promising direction for aligning language models with human intent and showing improvements in truthfulness and reductions in toxic output generation while having minimal performance regressions on public NLP datasets.

GaussianSelector: Lightweight Human-Guided Object Selection in 3D Gaussian Splatting with Graph Optimization
GaussianSelector:基于图优化的轻量级人工引导 3D 高斯溅射对象选择
arXiv:2608.01492 工程化 方法 OA · 绿色 被引 0 · S2 + OpenAlex

GaussianSelector 在选择质量上与 SOTA 的多视角 SAM 方法相当,同时所需交互视角显著更少、计算开销明显更低,因而非常适合真实场景下 human-in-the-loop 的 3D 场景编辑与 3D 资产提取。GaussianSelector achieves competitive selection quality against state-of-the-art multi-view SAM-based methods, while requiring significantly fewer interaction views and substantially lower computational overhead, which makes it well suited for human-in-the-loop 3D scene editing and 3D asset extraction in real-world deployment scenarios.

PyTorch: An Imperative Style, High-Performance Deep Learning Library
PyTorch:一种命令式风格的高性能深度学习库
arXiv:1912.01703 工程化 方法 OA · 绿色 被引 56184 · S2

本文详细阐述了驱动 PyTorch 实现的原则及其在架构中的体现,并解释了 runtime 关键组件的精心且务实的实现如何使其协同工作以获得出色的性能。This paper details the principles that drove the implementation of PyTorch and how they are reflected in its architecture, and explains how the careful and pragmatic implementation of the key components of its runtime enables them to work together to achieve compelling performance.

Communication-Efficient Learning of Deep Networks from Decentralized\n Data
从去中心化数据通信高效地学习深度网络
arXiv:1602.05629 工程化 方法 OA · 绿色 被引 27727 · S2

本文提出了一种基于迭代模型平均的深度网络联邦学习实践方法,并进行了广泛的实证评估,考虑了五种不同的模型架构和四个数据集。This work presents a practical method for the federated learning of deep networks based on iterative model averaging, and conducts an extensive empirical evaluation, considering five different model architectures and four datasets.

Federated Learning with Non-IID Data
使用非独立同分布数据的联邦学习
arXiv:1806.00582 工程化 方法 OA · 绿色 被引 3513 · S2

本文提出了一种通过创建在所有边缘设备之间全局共享的小型数据子集来改进非独立同分布数据训练的策略,并表明在 CIFAR-10 数据集上,仅共享 5% 的全局数据即可将准确率提升 30%。This work presents a strategy to improve training on non-IID data by creating a small subset of data which is globally shared between all the edge devices, and shows that accuracy can be increased by 30% for the CIFAR-10 dataset with only 5% globally shared data.

Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback
使用人类反馈强化学习训练有用且无害的助手
arXiv:2204.05862 工程化 方法 OA · 绿色 被引 4419 · S2

采用迭代的在线训练模式,按周节奏用新的人类反馈数据更新偏好模型与 RL 策略,并发现 RL 奖励与策略相对其初始化的 KL 散度平方根之间近似呈线性关系。An iterated online mode of training, where preference models and RL policies are updated on a weekly cadence with fresh human feedback data, and a roughly linear relation between the RL reward and the square root of the KL divergence between the policy and its initialization is identified.

YOLO-PEFT: Parameter-Efficient Fine-Tuning on YOLO Family
YOLO-PEFT:面向 YOLO 系列的参数高效微调
arXiv:2608.07051 工程化 应用落地 OA · 绿色 被引 0 · S2 + OpenAlex

提出 YOLO-PEFT,一个结构感知的框架,将 adapter 的放置建模为可审计的约束规划问题,以显式、可审查的规划取代手工对目标模块的试错,同时保留已验证的 train-save-merge-export 路径。YOLO-PEFT is proposed, a structure-aware framework that formulates adapter placement as an auditable constraint-planning problem that replaces manual target-module trial and error with explicit, inspectable planning while preserving verified train-save-merge-export paths.

Efficient Knowledge Distillation for LLMs: Offline Top-K Logits and a Fused Chunked KL Loss
高效 LLM 知识蒸馏:离线 Top-K Logits 与融合分块 KL 损失
arXiv:2608.03796 工程化 应用落地 OA · 绿色 被引 0 · S2 + OpenAlex

本文是一项关于如何提升蒸馏训练效率的实践研究,围绕两项系统贡献展开,并提出一种融合的 chunked KL loss,使峰值内存随序列长度线性增长。A practitioner's study of how to make distillation training efficient is presented, organised around two systems contributions, and a fused, chunked KL loss is introduced, making peak memory linear in the sequence length.

When Activation Oracles Learn Not to Read: Concept-Specific Blind Spots in Fine-Tuned Oracles
当激活预言机学会不去读取:微调预言机中的概念特定盲区
arXiv:2607.23379 工程化 方法 OA · 绿色 被引 1 · S2

研究发现,微调后的 AO 可能变成概念特异的 anti-reader:它们会选择性地无法恢复自身训练过程中持续存在的概念,从而对习得的可解释性接口提出可靠性担忧。It is found that fine-tuned AOs can become concept-specific anti-readers: they selectively fail to recover the concept persistently present during their own training, raising a reliability concern for learned interpretability interfaces.

Manifold Mixup: Better Representations by Interpolating Hidden States
Manifold Mixup:通过插值隐藏状态获得更好的表示
arXiv:1806.05236 工程化 方法 OA · 绿色 被引 470 · OpenAlex

Manifold Mixup 在监督学习、对单步对抗攻击的鲁棒性、半监督学习以及留出样本的负对数似然(NLL)上,相较强基线均取得了大幅提升。Manifold Mixup achieves large improvements over strong baselines in supervised learning, robustness to single-step adversarial attacks, semi-supervised learning, and Negative Log-Likelihood on held out samples.

DCAS: Decoupling CLI Agent Scaffolding to Internalize Planning across Scaffolds
DCAS:解耦 CLI Agent 脚手架以实现跨脚手架的规划内化
arXiv:2608.06113 工程化 应用落地 OA · 绿色 被引 2 · S2

提出 Decoupling CLI Agent Scaffolding(DCAS),一种后端替换的拦截层,可在不修改 scaffold 的前提下,在任意 CLI scaffold 与任意后端模型之间路由 API 流量,从而支持跨 scaffold 评估与具备规划感知的轨迹采集。Decoupling CLI Agent Scaffolding (DCAS) is introduced, a backend-substitution interception layer that routes API traffic between any CLI scaffold and any backend model without modifying the scaffold, enabling cross-scaffold evaluation and planning-aware trajectory collection.

AdvFD: Boosting Visual Generation via Adversarial Fr'echet Distance Loss
AdvFD:通过对抗 Fréchet 距离损失提升视觉生成
arXiv:2608.11205 工程化 方法 OA · 绿色 被引 1 · S2

对抗性 Fréchet 距离 (AdvFD) 用经过校准的对抗性学习表示来补充 FD-Loss 中的静态表示目标,通过对抗方式最大化真实样本与生成样本之间的 Fréchet 差异;同时引入真实特征白化,对尺度与协方差几何进行归一化,从而稳定极小极大优化。Adversarial Fr\'echet Distance (AdvFD), which complements the static representation targets in FD-Loss with a calibrated adversarially learned representation that adversarially maximizes the Fr\'echet discrepancy between real and generated samples, and introduces real-feature whitening, which normalizes its scale and covariance geometry and stabilizes the min--max optimization.

Reference-Free Post-Training of Open Large Language Models for Multilingual Machine Translation
面向多语言机器翻译的开源大语言模型无参考后训练
arXiv:2608.10812 工程化 方法 OA · 绿色 被引 0 · S2 + OpenAlex

本文研究基于开源大语言模型的无参考多语言机器翻译后训练,发现 on-policy 蒸馏能够达到但无法超越结合 checkpoint 插值的强化学习所确立的质量前沿。This work studies reference-free post-training for multilingual machine translation with open large language models and finds that on-policy distillation reaches, but does not surpass, the quality frontier achieved by RL with checkpoint interpolation.

Articulated Object Reconstruction from Rest-State Observation
基于静止状态观测的关节物体重建
arXiv:2607.27749 工程化 方法 OA · 绿色 被引 0 · S2 + OpenAlex

本文引入静止状态 (rest-state) 公式化方法,从单一闭合构型重建关节物体——这是一种固有的不适定设定,几何、语义与运动先验在此弥补运动线索的缺失。This work introduces a rest-state formulation that reconstructs articulated objects from a single closed configuration, an inherently ill-posed setting where geometry, semantics, and motion priors compensate for the absence of motion cues.

UniMoMo: Expert Merging-Based MoE Acceleration for Large Recommendation Models
UniMoMo:基于专家合并的大规模推荐模型 MoE 加速
arXiv:2608.08627 工程化 应用落地 OA · 绿色 被引 2 · S2

本文提出 UniMoMo,一种后训练压缩框架,将其形式化为约束图粗化问题,并引入分层自适应保护机制,根据路由暴露度限制对高流量 expert 的合并。UniMoMo, a post-training compression framework formulated as a constrained graph coarsening problem, is introduced, and a layer-adaptive protection mechanism that restricts the merging of high-traffic experts based on their routing exposure is introduced.

PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive Summarization
PEGASUS:基于抽取间隔句预训练的生成式摘要
arXiv:1912.08777 工程化 方法 OA · 绿色 被引 2589 · S2

本工作提出在海量文本语料上使用新的自监督目标 PEGASUS 对大型 Transformer 编码器-解码器模型进行预训练,并证明其在所有 12 个下游数据集上按 ROUGE 分数衡量均取得 SOTA 性能This work proposes pre-training large Transformer-based encoder-decoder models on massive text corpora with a new self-supervised objective, PEGASUS, and demonstrates it achieves state-of-the-art performance on all 12 downstream datasets measured by ROUGE scores.

A Survey on Multi-Task Learning
多任务学习综述
arXiv:1707.08114 工程化 综述 OA · 绿色 被引 3133 · S2

从算法建模、应用和理论分析角度对 MTL 的综述,给出了 MTL 的定义,并将不同 MTL 算法分为五类:特征学习方法、低秩方法、任务聚类方法、任务关系学习方法和分解方法A survey for MTL from the perspective of algorithmic modeling, applications and theoretical analyses, which gives a definition of MTL and classify different MTL algorithms into five categories, including feature learning approach, low-rank approach, task clustering approach,task relation learning approach and decomposition approach.

A Brief Review of Nature-Inspired Algorithms for Optimization
仿生优化算法简要综述
arXiv:1307.4186 工程化 综述 OA · 绿色 被引 679 · S2

较为全面地列举了基于群体智能、生物启发、物理启发和化学启发(按灵感来源分类)的所有算法,这些算法已成为解决实际问题的流行工具A relatively comprehensive list of all the algorithms based on swarm intelligence, bio-inspired, physics-based and chemistry-based, depending on the sources of inspiration, that have become popular tools for solving real-world problems.

Attention-Sensitive Alerting
注意力敏感的告警
arXiv:1301.6707 工程化 方法 OA · 绿色 被引 390 · S2

提出了能够平衡"延迟告警的上下文敏感成本"与"打断成本"的模型与推理流程,并通过对用户活动与通知内容的分析,描述了在不确定性下推理此类成本所面临的挑战Models and inference procedures that balance the context-sensitive costs of deferring alerts with the cost of interruption are presented and the challenge of reasoning about such costs under uncertainty via an analysis of user activity and the content of notifications is described.

Parameter Exploration for RLVR via Variational Learning
通过变分学习实现 RLVR 的参数空间探索
arXiv:2608.09805 工程化 方法 OA · 绿色 被引 0 · S2 + OpenAlex

本文提供了参数空间探索能够改进 LLM 强化学习的证据,并提出称为扰动参数策略优化(3PO)的方法族,使用不同的采样策略和不同的 rollout 分组进行 reward 估计。Evidence that parameter-space exploration can improve reinforcement learning for LLMs is presented, and a family of methods called Perturbed Parameter Policy Optimization (3PO) is introduced which use different sampling strategies and different rollout grouping for reward estimation.

Training Compute-Optimal Large Language Models
Training Compute-Optimal Large Language Models
arXiv:2203.15556 工程化 方法 OA · 绿色 被引 3830 · S2

本工作训练了一个预测的计算最优模型 Chinchilla,使用与 Gopher 相同的计算预算,但参数量为 70B、数据量为 4 倍,达到 SOTA 平均准确率,比 Gopher 提升超过 7%。This work trains a predicted compute-optimal model, Chinchilla, that uses the same compute budget as Gopher but with 70B parameters and 4$\times$ more more data, and reaches a state-of-the-art average accuracy, greater than a 7% improvement over Gopher.