介绍 Gemini for Google (GfG)，一款面向 Google 内部软件工程生态的 Gemini 专用适配版本，涵盖从构建万亿 token 的专有数据集到采用可缓解灾难性遗忘的中段训练策略的完整过程。G Gemini for Google (GfG)}, an adaptation of Gemini specialized for Google's internal software engineering ecosystem, is introduced, from curating a trillion-token proprietary dataset to implementing a mid-training strategy that mitigates catastrophic forgetting.
论文
6 张论文卡片 · 工程化 · 方法
条目 F: Google 企业定制 LLM — 代码转换实战数据
⑥ "How are MLOps Frameworks Used in Open Source Projects"（arXiv:2601.18591）
⑥ "How are MLOps Frameworks Used in Open Source Projects"（arXiv:2601.18591）
对八款主流开源 MLOps 框架的实践使用与功能增强需求进行调查，结果显示 MLOps 框架很少被直接开箱即用，也较少集成进 GitHub Workflows，开发者更多通过其 API 在项目中实现自定义功能。Investigating the practical use and desired feature enhancements of eight popular open-source MLOps frameworks indicates that users mainly ask for enhancements to core features of the frameworks, but also better API exposure and CI/CD integration.
4️⃣ arXiv · LoRAFusion（⭐⭐⭐ 值得追踪）
4️⃣ arXiv · LoRAFusion（⭐⭐⭐ 值得追踪）
本文提出 LoRAFusion，一种面向 LLM 的高效 LoRA 微调系统，可消除不必要的内存访问，在不付出重算或同步代价的前提下保持 compute-bound GEMM 的性能，并引入面向多任务微调的自适应批处理算法。LoRAFusion is introduced, an efficient LoRA fine-tuning system for LLMs that eliminates unnecessary memory accesses and preserves the performance of compute-bound GEMMs without incurring the cost of recomputation or synchronization and introduces an adaptive batching algorithm for multi-job fine-tuning.
3️⃣ arXiv · MatryoshkaLoRA（⭐⭐⭐⭐ 值得关注）
3️⃣ arXiv · MatryoshkaLoRA（⭐⭐⭐⭐ 值得关注）
本文提出 MatryoshkaLoRA，一种受 Matryoshka 启发、面向 LoRA 的通用训练框架，通过在已有 LoRA adapter 之间插入一个固定的、经精心设计的对角矩阵来按比例缩放其子秩，从而学习到准确的层次化低秩表示。MatryoshkaLoRA is proposed, a general, Matryoshka-inspired training framework for LoRA that learns accurate hierarchical low-rank representations by inserting a fixed, carefully crafted diagonal matrix between the existing LoRA adapters to scale their sub-ranks accordingly.
3. Kubernetes for GenAI Inference（arXiv:2602.04900v2）
Kubernetes for GenAI Inference（arXiv:2602.04900v2）
这些结果表明，Kueue、DAS 与 GAIE 等互补组件构成了一个高性能的协同平台，证明了 Kubernetes 能够作为承载高要求 GenAI 工作负载的统一底座。These findings illustrate that these complementary components (Kueue, DAS, and GAIE) form a cohesive, high-performance platform, proving Kubernetes' capability to serve as a unified foundation for demanding GenAI workloads.
2010.06047
2010.06047
总结了利用人工智能以及语音与语言处理预测阿尔茨海默病相关认知衰退的现有研究发现。The existing findings on the use of artificial intelligence, speech, and language processing to predict cognitive decline in the context of Alzheimer’s disease are summarized.