研究库 论文知识库
Papers · organized/paper_cards

论文

8 张论文卡片 · LLM 基础设施 · 应用落地 · OA 绿色

开放获取 全部 绿色 · 1640
1️⃣ RTP-LLM · 阿里巴巴工业级推理引擎 — arXiv:2605.29639(⭐⭐⭐⭐⭐ 必读)
arXiv:2605.29639 LLM 基础设施 应用落地 OA · 绿色 被引 2 · S2

RTP-LLM 是一个面向工业级 LLM 部署的高性能推理引擎,已在 Alibaba Group 成功部署,服务超过 1 亿用户,通过集成设计解决根本性瓶颈。RTP-LLM is presented, a high-performance inference engine for industrial-scale LLM deployment, successfully deployed across Alibaba Group serving over 100 million users, and addresses fundamental bottlenecks through integrated design.

FlashPrefill V2: Block-Sparse Prefill Attention for Long-Context LLM Serving
FlashPrefill V2:面向长上下文 LLM 服务的块稀疏 Prefill 注意力
arXiv:2608.19758 LLM 基础设施 应用落地 OA · 绿色 被引 2 · S2

本文引入一个均值修正项,有效抑制近似误差,即使在极端稀疏度下也能将性能下降保持在可控范围;并使用 PackGQA 内存访问、warp specialization 和 pingpong 流水线重新设计稀疏注意力算子。This paper introduces a mean correction term that effectively suppresses the approximation error, keeping performance degradation manageable even at extreme sparsity levels, and redesigns the sparse attention operator with PackGQA memory access, warp specialization, and pingpong pipelining.

Quantization-Aware Healing: A Practical Recipe for Recovering Compressed, 4-Bit LLMs
量化感知修复:恢复压缩后 4-Bit LLM 的实用方案
arXiv:2608.20953 LLM 基础设施 应用落地 OA · 绿色 被引 0 · S2 + OpenAlex

目标是提供无需数周超参搜索即可部署的方案,直接从原始未压缩模型蒸馏 4-bit 学生模型,并以开源权重形式发布为 Hypernova-60B。The aim is a recipe deployable without a multi-week hyper-parameter search, which distills the 4-bit student directly from the original, uncompressed model, and is released open-weight as Hypernova-60B.

DeepSeek-V4.1-Flash: Pushing the Limits of KV Cache Compression
DeepSeek-V4.1-Flash:突破 KV Cache 压缩的极限
arXiv:2609.19969 LLM 基础设施 应用落地 OA · 绿色 被引 43 · S2

推出 DeepSeek-V4.1-Flash 模型,这是一个具有 552B 骨干参数、支持最长一百万 token 上下文的多模态 Mixture-of-Experts 模型,显著提升了 agent 工作负载的成本效率,并突破了 KV cache 压缩的极限。The DeepSeek-V4.1-Flash model, a multimodal Mixture-of-Experts model with 552B backbone parameters and support for contexts of up to one million tokens, is introduced, substantially improving cost efficiency for agentic workloads and pushing the limits of KV cache compression.

Blaming Across the Aisle: Political Contrasting and Blame Attribution in the Danish Parliament
跨越党派指责:丹麦议会中的政治对比与归责
arXiv:2609.26346 LLM 基础设施 应用落地 OA · 绿色 被引 0 · S2 + OpenAlex

政治话语日益呈现更强的敌对感是普遍观感,但稳健证据仍稀缺。本文研究 1997 至 2026 年丹麦议会的归责行为,结合专门构建的分类器 BlameBERT(F1: 0.80)与多层统计建模。该分类器采用面向低至中等资源语言的标注高效流程。结果显示出一条香蕉形轨迹:归责水平约在 2016 年前下降,随后在近年(2019–2026)进入显著且持续的上升阶段。执政地位显著Political discourse is widely perceived to be growing more hostile, yet robust evidence remains scarce. This study examines blame attribution in the Danish Parliament from 1997 to 2026, combining a purpose-built classifier, BlameBERT (F1: 0.80), with multilevel statistical modeling. The classifier is constructed using an annotation-efficient pipeline for blame attribution in low-to-mid resource languages. The results reveal a banana-shaped trajectory, with blame declining until around 2016 before entering a significant and sustained increase in recent years (2019-2026). Government status consi

GigaWorld-Policy-0.5: A Faster and Stronger WAM Empowered by AutoResearch
GigaWorld-Policy-0.5: A Faster and Stronger WAM Empowered by AutoResearch
arXiv:2607.13960 LLM 基础设施 应用落地 OA · 绿色 被引 7 · S2

GigaWorld-Policy-0.5 在保留未来视觉动力学训练收益的同时提升了机器人控制的推理效率,并引入 Mixture-of-Transformers 架构,将视觉动力学建模与动作生成分离到专门的专家模块中。GigaWorld-Policy-0.5 preserves the training benefits of future visual dynamics while improving inference efficiency for robot control, and introduces a Mixture-of-Transformers architecture that separates visual dynamics modeling and action generation into specialized experts.

Meshy T2: Fast Native Mesh Generation with Flow Matching
Meshy T2:基于 Flow Matching 的快速原生网格生成
arXiv:2607.28675 LLM 基础设施 应用落地 OA · 绿色 被引 3 · S2

Meshy T2在几何保真度上达到SOTA,端到端图像到网格生成中位耗时6秒,比自回归基线快一个数量级以上。Meshy T2 achieves state-of-the-art geometric fidelity and completes end-to-end image-to-mesh generation within a median of 6 seconds, over an order of magnitude faster than autoregressive baselines.

Large Language Models Encode Clinical Knowledge
大语言模型编码临床知识
arXiv:2212.13138 LLM 基础设施 应用落地 OA · 绿色 被引 5318 · S2

提出 MultiMedQA 基准,整合六个现有医学问答数据集(涵盖专业医学、研究与消费者查询)及一个全新的在线医学问题搜索数据集,并提出针对模型答案的人工评估框架,揭示了 LLM 在医学领域的潜在应用价值。MultiMedQA, a benchmark combining six existing medical question answering datasets spanning professional medicine, research and consumer queries and a new dataset of medical questions searched online, is presented and a human evaluation framework for model answers is proposed, suggesting the potential utility of LLMs in medicine.