《大模型推理原理与优化》:面向系统/架构/后端研发工程师的模型原理入门课,目标是通俗易懂的解释推理过程,理解原理有助于系统开发/维护工作
仓库/Skill 库
46 个 · LLM 基础设施 · 应用
通过 MegaQwen CUDA megakernel 加速 Qwen3-0.6B 推理,在 RTX 3090 上达到 531 tok/s decode,较 HuggingFace 提升 3.9×🚀 Achieve faster Qwen3-0.6B inference with the MegaQwen CUDA megakernel, delivering 531 tok/s decode on RTX 3090—3.9x faster than HuggingFace.
完全在浏览器中通过 WebAssembly 实现文档转换、检查、OCR 与翻译。保留版式的翻译,全程本地、离线优先。Convert, inspect, OCR, and translate any document entirely in the browser via WebAssembly. Layout-preserving translation, fully local, offline-first.
metaScreener——基于插件的桌面应用,用于 human-in-the-loop systematic literature screening。在顺序可审计的 pipeline 中结合确定性启发式过滤与 LLM 推理,通过 SHA-256 校验包实现完全可复现。MIT 协议。metaScreener — a plugin-based desktop application for human-in-the-loop systematic literature screening. Combines deterministic heuristic filters with LLM inference in a sequential, auditable pipeline. SHA-256 verified bundles for full reproducibility. MIT licensed.
🛠 通过此硬件插件提升 vLLM 在 Kunlun XPU 上的性能,无缝集成主流 AI 模型并优化执行效率🛠 Enhance vLLM performance on Kunlun XPU with this hardware plugin, offering seamless integration for popular AI models and optimized execution.
面向科学与医学写作的人性化润色的阿英双语 skill,同时保持学术准确性。Bilingual Arabic-English skill for humanizing scientific and medical writing while preserving scholarly accuracy.
基于仿真的 MRI 调度策略分析,结合统计分析与离散事件仿真,以优化资源利用率、等待时间、加班时长与患者吞吐量。Simulation-based analysis of MRI scheduling policies, combining statistical analysis and discrete-event simulation to optimize resource utilization, waiting times, overtime, and patient throughput.
使用纯 C99 MoE 推理引擎在 CPU 上原生运行 DeepSeek-V4-Flash-0731,无需 GPU、CUDA 或 PyTorch。Run native DeepSeek-V4-Flash-0731 on CPU with a pure C99 MoE inference engine — no GPU, CUDA, or PyTorch needed.
基于 Torch2PC 的预测编码硕士论文可复现项目:在 Ubuntu/ROCm 上对 backpropagation 进行逐层与 compute-matched 对比,实现 PC-CATM/PC-TREF,对 state inference 进行机制诊断,并构建 QWake-PC 以实现自适应 exact inference —— 面向机制可解释的可复现预测编码研究。Воспроизводимый проект магистерской диссертации по predictive coding в Torch2PC: послойное и compute-matched сравнение с backpropagation, PC-CATM/PC-TREF, механизмная диагностика state inference и QWake-PC для адаптивного exact inference в Ubuntu/ROCm — reproducible research on mechanism-aware predictive coding.
SLM-PICO-Screener 是用于自动化系统综述筛选的轻量 NLP 流水线,基于 Phi-3 Mini 配合 LoRA 与 4-bit 量化,将文章分类为 8 个 PICO 标签。体积约 90 MB,可在消费级 GPU/CPU 上运行,加速生物医学研究中的证据综合。SLM-PICO-Screener is a lightweight NLP pipeline automating systematic review screening. Built on Phi-3 Mini with LoRA & 4-bit quantization, it classifies articles into 8 PICO labels. At ~90 MB, it runs on consumer GPUs/CPU, accelerating evidence synthesis in biomedical research.