RTP-LLM 是一个面向工业级 LLM 部署的高性能推理引擎，已在 Alibaba Group 成功部署，服务超过 1 亿用户，通过集成设计解决根本性瓶颈。RTP-LLM is presented, a high-performance inference engine for industrial-scale LLM deployment, successfully deployed across Alibaba Group serving over 100 million users, and addresses fundamental bottlenecks through integrated design.
论文
2 张论文卡片 · LLM 基础设施 · 应用落地
1️⃣ RTP-LLM · 阿里巴巴工业级推理引擎 — arXiv:2605.29639（⭐⭐⭐⭐⭐ 必读）
Large Language Models Encode Clinical Knowledge
大语言模型编码临床知识
提出 MultiMedQA 基准，整合六个现有医学问答数据集（涵盖专业医学、研究与消费者查询）及一个全新的在线医学问题搜索数据集，并提出针对模型答案的人工评估框架，揭示了 LLM 在医学领域的潜在应用价值。MultiMedQA, a benchmark combining six existing medical question answering datasets spanning professional medicine, research and consumer queries and a new dataset of medical questions searched online, is presented and a human evaluation framework for model answers is proposed, suggesting the potential utility of LLMs in medicine.