仓库/Skill 库

快速上手 Kimi-K2.6、GLM-5.2、MiniMax、DeepSeek、gpt-oss、Qwen、Gemma 等模型Get up and running with Kimi-K2.6, GLM-5.2, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.

基于 C/C++ 的 LLM 推理实现LLM inference in C/C++

LLM 入门课程，附路线图与 Colab notebookCourse to get into Large Language Models (LLMs) with roadmaps and Colab notebooks.

GPT4All：在任意设备上运行本地 LLM。开源且可用于商业用途。GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.

Ray 是一个 AI 计算引擎,由核心分布式运行时和一套用于加速 ML 工作负载的 AI 库组成。Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

DeepSpeed 是一个深度学习优化库，使分布式训练和推理变得简单、高效且有效。DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

让大型 AI 模型更便宜、更快速、更易用。Making large AI models cheaper, faster and more accessible

一个 AI 提示词优化器，用于编写更好的提示词并获得更好的 AI 结果。An AI prompt optimizer for writing better prompts and getting better AI results.

📚 从零开始构建大模型

开源 AI 平台——支持所有 LLM 的 AI Chat，并提供丰富的高级功能。Open Source AI Platform - AI Chat with advanced features that works with every LLM

用简单、原生的 C/CUDA 进行 LLM 训练LLM training in simple, raw C/CUDA

📦 Repomix 是一个强大的工具，能将整个仓库打包为单个对 AI 友好的文件。非常适合需要将代码库喂给 LLM 或其他 AI 工具（如 Claude、ChatGPT、DeepSeek、Perplexity、Gemini、Gemma、Llama、Grok 等）的场景。📦 Repomix is a powerful tool that packs your entire repository into a single, AI-friendly file. Perfect for when you need to feed your codebase to Large Language Models (LLMs) or other AI tools like Claude, ChatGPT, DeepSeek, Perplexity, Gemini, Gemma, Llama, Grok, and more.

用于快速文本表示与分类的库。Library for fast text representation and classification.

本项目旨在分享大模型相关技术原理以及实战经验（大模型工程化、大模型应用落地）

ncnn 是一个为移动平台优化的高性能神经网络推理框架。ncnn is a high-performance neural network inference framework optimized for the mobile platform

本地化、开源的 AI 应用构建器，面向高级用户 ✨ v0 / Lovable / Replit / Bolt 的替代方案 🌟 喜欢就点 Star！Local, open-source AI app builder for power users ✨ v0 / Lovable / Replit / Bolt alternative 🌟 Star if you like it!

FinGPT:开源金融大语言模型!革命性 🔥 已在 HuggingFace 发布训练好的模型。FinGPT: Open-Source Financial Large Language Models! Revolutionize 🔥 We release the trained model on HuggingFace.

中文LLaMA&Alpaca大语言模型+本地CPU/GPU训练部署 (Chinese LLaMA & Alpaca LLMs)

结构化输出（Structured Outputs）Structured Outputs

面向机器学习的 Tensor 库Tensor library for machine learning

🎨 TypeScript 的穷尽式 Pattern Matching 库，具备智能类型推断。🎨 The exhaustive Pattern Matching library for TypeScript, with smart type inference.

Nano vLLM。Nano vLLM

NVIDIA® TensorRT™ 是在 NVIDIA GPU 上进行高性能深度学习推理的 SDK。本仓库包含 TensorRT 的开源组件。NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source components of TensorRT.

在云端以 OpenAI 兼容 API 端点形式运行任意开源 LLM，例如 DeepSeek 和 Llama。Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

复旦大学开源的工具增强对话语言模型An open-source tool-augmented conversational language model from Fudan University

LMCache：借助最快的 KV Cache 层为你的 LLM 加速。LMCache: Supercharge Your LLM with the Fastest KV Cache Layer

示例 📓 Jupyter notebooks，演示如何使用 🧠 Amazon SageMaker 构建、训练和部署机器学习模型。Example 📓 Jupyter notebooks that demonstrate how to build, train, and deploy machine learning models using 🧠 Amazon SageMaker.

Triton Inference Server 提供针对云端和边缘推理优化的解决方案。The Triton Inference Server provides an optimized cloud and edge inferencing solution.

OpenVINO™ 是用于优化和部署 AI 推理的开源工具包OpenVINO™ is an open source toolkit for optimizing and deploying AI inference

基于 PyTorch 的 YOLOv3、YOLOv3-SPP 和 YOLOv3-tiny 实时目标检测实现，支持训练、验证、推理与多格式导出。PyTorch implementation of YOLOv3, YOLOv3-SPP, and YOLOv3-tiny for real-time object detection with training, validation, inference, and multi-format export.

用于本地运行 AI 的生产就绪工具包。Production ready toolkit to run AI locally

LLM 实战指南资源的精选清单（LLMs Tree、示例、论文）A curated list of practical guide resources of LLMs (LLMs Tree, Examples, Papers)

面向本地部署的高速 LLM 服务High-speed Large Language Model Serving for Local Deployment

提供 AI 应用和模型服务的最简方式 —— 构建模型推理 API、任务队列、LLM 应用、多模型 pipeline 等。The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!

🚀💪Maximize your efficiency and productivity. The ultimate hub to manage, customize, and share prompts. (English/中文/Español/العربية). 让生产力加倍的 AI 快捷指令。更高效地管理提示词，在分享社区中发现适用于不同场景的灵感。

Transformer 可视化解析：通过交互式可视化学习 LLM Transformer 模型的工作原理。Transformer Explained Visually: Learn How LLM Transformer Models Work with Interactive Visualization