趋势榜

🐢 一个精选的浏览器端 JavaScript 库、资源和精彩内容的合集。🐢 A collection of awesome browser-side JavaScript libraries, resources and shiny things.

为 LLM 优化推理代理Optimizing inference proxy for LLMs

面向 LLM、VLM、DiT 和 REC 模型的高性能推理引擎，针对多种 AI 加速器进行了优化。该项目托管于 OpenAtom 基金会。A high-performance inference engine for LLM, VLM, DiT and REC models, optimized for diverse AI accelerators. It is hosted in OpenAtom Foundation.