论文

介绍 Gemini for Google (GfG)，一款面向 Google 内部软件工程生态的 Gemini 专用适配版本，涵盖从构建万亿 token 的专有数据集到采用可缓解灾难性遗忘的中段训练策略的完整过程。G Gemini for Google (GfG)}, an adaptation of Gemini specialized for Google's internal software engineering ecosystem, is introduced, from curating a trillion-token proprietary dataset to implementing a mid-training strategy that mitigates catastrophic forgetting.

对八款主流开源 MLOps 框架的实践使用与功能增强需求进行调查，结果显示 MLOps 框架很少被直接开箱即用，也较少集成进 GitHub Workflows，开发者更多通过其 API 在项目中实现自定义功能。Investigating the practical use and desired feature enhancements of eight popular open-source MLOps frameworks indicates that users mainly ask for enhancements to core features of the frameworks, but also better API exposure and CI/CD integration.

实验表明，DataEvolver 显著提升了数据质量，相比在原始数据上训练，下游 LLM 性能平均提升 10%，凸显了 LLM 与数据迭代协同演化的新机遇。Experiments show that DataEvolver substantially improves data quality and achieves an average 10\% gain in downstream LLM performance compared with training on original data, highlighting new opportunities for the iterative co-evolution of LLMs and data.

本文提出 MatryoshkaLoRA，一种受 Matryoshka 启发、面向 LoRA 的通用训练框架，通过在已有 LoRA adapter 之间插入一个固定的、经精心设计的对角矩阵来按比例缩放其子秩，从而学习到准确的层次化低秩表示。MatryoshkaLoRA is proposed, a general, Matryoshka-inspired training framework for LoRA that learns accurate hierarchical low-rank representations by inserting a fixed, carefully crafted diagonal matrix between the existing LoRA adapters to scale their sub-ranks accordingly.

这些结果表明，Kueue、DAS 与 GAIE 等互补组件构成了一个高性能的协同平台，证明了 Kubernetes 能够作为承载高要求 GenAI 工作负载的统一底座。These findings illustrate that these complementary components (Kueue, DAS, and GAIE) form a cohesive, high-performance platform, proving Kubernetes' capability to serve as a unified foundation for demanding GenAI workloads.

CONFLUX 是一个面向胸部 CT 的潜在扩散模型：由 3D 变分自编码器压缩每个体数据，整流流 Transformer 在潜在空间中生成，并以分类器从生成体中恢复所请求病征的可靠性作为奖励。CONFLUX, a latent diffusion model for chest computed tomography (CT): a 3D variational autoencoder compresses each volume, and a rectified-flow transformer generates in the latent space, that rewards how reliably a classifier recovers the requested findings from each generated volume.

首个面向预训练胸部 X 光报告生成器的无需训练 best-of-N 采样方案，显式建模"既往-当前-过渡"纵向先验，全面优于随机选择。This work presents the first training-free best-of-N sampling scheme for pre-trained chest X-ray report generators that is explicitly aware of this longitudinal prior to current transition, and outperforms random selection across the board.

本文提出了 Graph-PRefLexOR，这是一族基于图结构的推理模型，使用 Group Relative Policy Optimization 进行微调，将推理过程组织为显式阶段，分别用于机理探索、图构建、模式提取和假设合成，确立了面向图结构的强化学习作为通向可解释 AI 系统的路径，可应用于材料设计及其他科学领域的科学假设生成。Graph-PRefLexOR is developed, a family of graph-native reasoning models fine-tuned with Group Relative Policy Optimization to organize reasoning into explicit phases for mechanism exploration, graph construction, pattern extraction, and hypothesis synthesis, establishing graph-native reinforcement learning as a pathway toward interpretable AI systems for scientific hypothesis generation in materials design and other scientific applications.

本文提出 Monotonic Inference Policy Update (MIPU)，一种两步式 LLM 强化学习框架：构建采样器引用的候选更新，并使用推理侧差距代理选择性接受同步候选；实验表明 MIPU 提升了平均推理性能与训练稳定性。Monotonic Inference Policy Update (MIPU) is introduced, a two-step LLM RL framework that constructs sampler-referenced candidate updates and selectively accepts synchronized candidates using an inference-side gap proxy, and experiments show that MIPU improves average reasoning performance and training stability.

本文提出 MultiDepth-3k (MD-3k)，一个用于衡量深度层偏好与多层空间关系准确率 (ML-SRA) 的稀疏双层序数基准；领先的深度基础模型在标准 RGB 输入下表现出不同的层偏好，表明同一分层几何可在不同模型中被差异化地解析。MultiDepth-3k (MD-3k), a sparse two-layer ordinal benchmark for measuring depth-layer preference and multi-layer spatial relationship accuracy (ML-SRA), is introduced and leading depth foundation models exhibit diverse layer preferences under standard RGB input, showing that the same layered geometry can be resolved differently across models.

水电隧道检测对基础设施完整性至关重要，但人工方式效率低下且具有危险性。本文提出 FLISP（Fast LiDAR-IMU Synchronized Path Planner），一种面向 UGV-UAV 协同检测的无地图规划框架。不同于传统基于地图的范式，FLISP 具有三项核心贡献：(1) 统一架构，由单套 UGV 搭载的 LiDAR-IMU 驱动两平台的同步路径生成；(2) 平台特定的求解器，采用增强型萤火虫算法用于 UGV 避障，以及动态迭代优化器用于 UAHydropower tunnel inspection is critical for infrastructure integrity yet remains inefficient and hazardous using manual methods. We propose FLISP (Fast LiDAR-IMU Synchronized Path Planner), a mapless planning framework for cooperative UGV-UAV inspection. Unlike traditional map-based paradigms, FLISP features three core contributions: (1) a unified architecture where a single UGV-mounted LiDAR-IMU suite drives synchronized path generation for both platforms; (2) platform-specific solvers utilizing an enhanced Firefly Algorithm for UGV obstacle avoidance and a dynamic iterative optimizer for UA

实验表明，LISA 不仅能持续加速训练收敛并提升最终合成结果，还能促使侧网络特征在条件建模中更加解耦，且几乎无额外训练成本，推理成本为零。Experiments demonstrated that LISA can not only consistently accelerate the training convergence and improve final synthetic results, but also encourage the side network's features to be more disentangled for conditional modeling with negligible additional training cost and zero extra inference cost.

介绍 Stanford EDGAR Filings Dataset（SEFD），一个将 SEC filings 开放重建为版面保真 MultiMarkdown 的数据集，用于金融语言建模与评估；同时推出两个基于 SEFD 的基准：EDGAR-Forecast，用于评估模型知识截止后基于 filings 的数值预测；EDGAR-OCR，用于评估复杂金融表格的转录质量。The Stanford EDGAR Filings Dataset (SEFD), an open reconstruction of SEC filings into layout-faithful MultiMarkdown for financial language modeling and evaluation, is introduced and two SEFD-derived benchmarks are introduced: EDGAR-Forecast, which evaluates filing-grounded numerical forecasting after model knowledge cutoffs, and EDGAR-OCR, which evaluates transcription of complex financial tables.

本文提出 MedEasy，一个多 Agent 系统，通过患者对话、临床操作、决策提交、文档记录与反馈来组织虚拟患者练习，为使用案例特定标准连接情境化实践的 AI 辅助职业训练系统贡献了设计启示。MedEasy is presented, a multi-agent system that organizes virtual-patient practice through patient dialogue, clinical actions, decision submission, documentation, and feedback that contributes design implications for AI-supported professional training systems that use case-specific standards to connect situated practice.

提出 OmniTacTune，一种策略无关的真实世界 RL 流程，通过残差修正将触觉反馈适配到预训练视觉策略，并在多种接触丰富任务、视觉基础策略与触觉表征间实现泛化。OmniTacTune is introduced, a policy-agnostic real-world RL pipeline that adapts tactile feedback to pretrained visual policies through residual correction and generalizes across diverse contact-rich tasks, visual base policies, and tactile representations.

给出一个具体且有实证支撑的像素级 EO 基础模型扩展方案：训练大型 encoder，按下游性能筛选，再蒸馏为灵活的学生模型。A concrete, empirically grounded recipe for scaling pixel-wise EO foundation models: train large encoders, select by downstream performance, and distil into flexible student models is given.

借助强大的全景先验，Canvas360 构建了一个统一的上下文全景生成框架，通过 token 级拼接支持多样化下游任务，在任务覆盖范围与建模灵活性上均超越已有方法。Empowered by strong panoramic priors, Canvas360 enables a unified in-context panoramic generation framework that supports diverse downstream tasks via token-level concatenation, surpassing prior methods in both task coverage and modeling flexibility.

提出 PAST-TIDE，在官方排行榜上 Subtask A 取得 0.75 的 macro-F1，Subtask B 取得 0.74，表明对预训练模型仅做极少的架构改动即可在低资源场景下保持竞争力。PAST-TIDE is introduced, PAST-TIDE achieves macro-F1 scores of 0.75 for Subtask A and 0.74 for Subtask B on the official leaderboard, indicating that minimal architectural additions to a pre-trained model can remain competitive in low-resource settings.

通过将疾病特异性上下文整合到分子生成中，DrugGen-2 推动了 AI 辅助药物发现，为 de novo 设计和药物再利用提供了强大工具，可同时考虑疾病与分子靶点之间的复杂相互作用。By integrating disease-specific context into molecular generation, DrugGen-2 advances AI-assisted drug discovery, offering a powerful tool for de novo design and drug repurposing that accounts for the complex interplay between diseases and molecular targets.

本工作描述了如何在开源实现中满足使用有限项数的截断态向量来模拟 peaked circuits 的要求，并讨论了其性能与局限性。This work describes how the requirements to simulate peaked circuits using a truncated state vector with a limited number of terms were met in an open-source implementation, and discusses its performance and limitations.

论文提出 PanoWorld，通过固定朝向将相机轨迹简化为平移，并借助 Dense Panoramic Ray-Conditioning 与 Geometry-aware Memory Augmentation 同时支持当前动作建模与长程记忆。PanoWorld is proposed, which simplifies camera trajectories into translations via fixed headings for both current-action modeling and long-range memory through Dense Panoramic Ray-Conditioning and Geometry-aware Memory Augmentation through Dense Panoramic Ray-Conditioning and Geometry-aware Memory Augmentation.

一种简单方法 Self-Guided TTT (S-TTT)，可同时提升 Qwen3-4B-Thinking-2507 与 Llama-3.1-8B-Instruct 的准确率，相对改进最高达 15%。A simple method, Self-Guided TTT (S-TTT), which improves accuracy for both Qwen3-4B-Thinking-2507 and Llama-3.1-8B-Instruct, achieving up to a 15% relative improvement.

提出 Direct On-Policy Distillation（Direct-OPD），该方法迁移教师模型由 RL 引起的策略偏移，而非在目标模型上运行稀疏奖励 RL，并一致地利用更弱的教师模型来提升更强的目标模型Direct On-Policy Distillation (Direct-OPD) is proposed, which transfers the teacher's RL-induced policy shift instead of running sparse-reward RL on the target model and consistently leverages weaker teachers to improve stronger target models.

提出 Proxy OPD——一种异步后训练框架，迁移奖励驱动的策略改进而非绝对策略分布，将相对策略更新确立为可大规模、按奖励进行后训练的高复用、可调节资产。Proxy OPD is introduced, an asynchronous post-training framework that transfers reward-induced policy improvements rather than absolute policy distributions and establishes relative policy updates as highly reusable, adjustable assets for scalable, reward-based post-training.

一个全栈系统，可从第一人称人类视频扩展灵巧 VLA 的预训练，并支持数据高效的真实机器人后训练，在 40+ 多种任务上稳健执行自由形式指令，展现出失败恢复、灵巧性与泛化能力。A full-stack system that scales dexterous VLA pre-training from egocentric human videos and enables data-efficient real-robot post-training that robustly executes free-form instructions across 40+ diverse tasks, demonstrating failure recovery, dexterity, and generalization.

提出 SpectraReward，一种无需训练的将预训练 MLLM 转化为即用型奖励模型的奖励函数，用于图像生成强化学习；并引入 Self-SpectraReward，这是统一多模态模型的一种特例，其中策略自身的理解分支充当其生成分支的奖励模型。SpectraReward is proposed, a training-free reward function that turns pretrained MLLMs into off-the-shelf reward models for image-generation reinforcement learning, and Self-SpectraReward is introduced, a special case for unified multimodal models where the policy's own understanding branch serves as the reward model for its generation branch.

本文对 OPD 的作用、病态与调控进行系统研究，厘清 OPD 作为探索催化剂的角色，并证实调控良好的信号质量（而非单纯的教师模型规模）才是 OPD 中成功探索的主导因素。A systematic study examining the role, pathologies, and regulations of OPD, clarifying the role of OPD as an exploration catalyst and confirming that well-regulated signal quality, rather than mere teacher scale, governs successful exploration in OPD.

BLIP-2 在多种视觉-语言任务上取得 SOTA 性能，可训练参数远少于现有方法，并展现出遵循自然语言指令进行零样本图生文的新兴能力。BLIP-2 achieves state-of-the-art performance on various vision-language tasks, despite having significantly fewer trainable parameters than existing methods, and is demonstrated's emerging capabilities of zero-shot image-to-text generation that can follow natural language instructions.

大量实验表明，Distilled RL 在 pass@1 和 pass@k 上均显著优于标准 RL 和 OPD，并能将教师模型中此前无法获得的知识有效迁移至学生模型。Extensive experiments show that Distilled RL substantially outperforms standard RL and OPD in terms of both pass@1 and pass@k, and can effectively transfer previously unavailable knowledge from a teacher model to a student model.

本文针对中亚低资源语言构建鲁棒基础模型的挑战，提出 GigaAM Multilingual：一个基于 HuBERT 风格目标在 2M 小时音频上预训练的 Conformer encoder，并在预训练阶段引入 cluster 级的数据均衡策略，在微调阶段引入域感知采样方法，以缓解头部语言主导问题。This work addresses the challenge of building robust foundation models for underrepresented Central Asian languages by presenting GigaAM Multilingual, a Conformer encoder pre-trained on 2M hours of audio using a HuBERT-style objective, and introduces a cluster-level data balancing strategy during pre-training and a domain-aware sampling method during fine-tuning to mitigate head-language dominance.

本文研究 SkewAdam——一种基于以下观察构建的优化器：MoE 的三类参数群体在规模与梯度统计上差异足够大，不应共享相同的状态；研究表明优化器状态的存放位置至少与状态容量同等重要。SkewAdam, an optimizer built on the observation that the three parameter populations of an MoE differ enough in size and gradient statistics that they should not receive the same state, is studied, suggesting where optimizer state lives matters at least as much as how much of it there is.

研究发现，在上述多个维度上进行的指令微调可显著提升多种模型类别（PaLM、T5、U-PaLM）、多种提示设定以及多种评测基准（MMLU、BBH、TyDiQA、MGSM、开放式生成）上的表现。It is found that instruction finetuning with the above aspects dramatically improves performance on a variety of model classes (PaLM, T5, U-PaLM), prompting setups, and evaluation benchmarks (MMLU, BBH, TyDiQA, MGSM, open-ended generation).

一个能够将任意自然语言任务轻松映射为人类可读 prompt 形式的系统，并在覆盖多种任务的多任务混合数据上对预训练 encoder-decoder 模型进行微调。A system for easily mapping any natural language tasks into a human-readable prompted form and fine-tune a pretrained encoder-decoder model on this multitask mixture covering a wide variety of tasks.

本文开发并发布了 Llama 2，这是一系列参数规模从 70 亿到 700 亿不等的预训练与微调大语言模型（LLMs），有望成为闭源模型的合适替代品。This work develops and releases Llama 2, a collection of pretrained and fine-tuned large language models (LLMs) ranging in scale from 7 billion to 70 billion parameters, which may be a suitable substitute for closed-source models.

本研究证实了激活函数之间存在统计显著的性能差异，从而再次确认了非饱和函数在深度架构中的必要性，并恢复了对此前文献的恰当历史归属。This study confirms a statistically significant performance variance among activations, thus reaffirming the necessity of non-saturating functions in deep architectures, and restores proper historical attribution to prior literature.

一种基于二部交互图上可微分消息传递的图自编码器框架，在标准协同过滤基准上表现出竞争力，并优于近期的 SOTA 方法。A graph auto-encoder framework based on differentiable message passing on the bipartite interaction graph that shows competitive performance on standard collaborative filtering benchmarks and outperforms recent state-of-the-art methods.