仓库/Skill 库

关于大语言模型 On-Policy Distillation 的精选论文与资源合集A curated collection of papers and resources on On-Policy Distillation for Large Language Models.

OpenSkills：使用任意 LLM 在本地运行 Claude Skills。OpenSkills: Run Claude Skills Locally using any LLM

Qwen3.8-27B 在单卡 RTX 3090 上使用 vLLM 部署：64 并发下约 1,000 tok/s（int8 张量核心 GEMM、fp16 DeltaNet 状态），默认采样下单用户约 114 tok/s/贪心约 124 tok/s（MTP 草稿、自输出草稿词表、校准 int4 lm_head、split-KV 校验注意力），150k–262k 上下文；附带补丁、重新量化脚本与基准测试Qwen3.8-27B on a single RTX 3090 with vLLM: ~1,000 tok/s at 64 concurrent (int8 tensor-core GEMMs, fp16 DeltaNet state), ~114 tok/s single-user at default sampling / ~124 greedy (MTP drafts, own-output draft vocab, calibrated int4 lm_head, split-KV verify attention), 150k-262k context; patches, requant scripts, benchmarks

StarWhisper 天文 LLMs、StarWhisper Telescope、Virtual-GOTTA，以及面向 embodied observing workflow 的天文定制研究 skills。StarWhisper astronomy LLMs, StarWhisper Telescope, Virtual-GOTTA, and astronomy-adapted research skills for embodied observing workflows

🪢 Langfuse 文档——Langfuse 是开源 LLM 工程平台，提供可观测性、评估、Prompt 管理、Playground 与指标，用于调试与改进 LLM 应用🪢 Langfuse documentation -- Langfuse is the open source LLM Engineering Platform. Observability, evals, prompt management, playground and metrics to debug and improve LLM apps

DeepSeek v4 Flash EXL3 运行于单台 DGX SparkDeepSeek v4 Flash EXL3 on one DGX Spark

LLM7.io 提供单一 API 网关，可连接来自多家供应商的众多领先 AI 模型LLM7.io offers a single API gateway that connects you to a wide array of leading AI models from various providers.

Google Deep Search 的实现，支持 1000+ 篇参考文献、本地推理、使用 RAPTOR 与抓取会话对话以及报告生成。An implementation of Google Deep Search with support for 1000+ references, local inference, chatting with your scraping session using RAPTOR, and report generation.

在两台 dgx-spark 上从零部署 deepseek-flash-0731 的设置指南。setup guide for deepseek-flash-0731 on two dgx-spark from scratch

Qwen3.8 27B 在 SGLang 上运行于 DGX SparkQwen3.8 27B on SGLang for DGX Spark

一门实战课程，用 PyTorch 从零构建现代 LLM，包含 26 个可运行的 Jupyter Notebook，涵盖 tokenizer、attention、MoE、RLHF、推理、评估和蒸馏。A hands-on course for building modern LLMs from scratch in PyTorch, with 26 runnable Jupyter Notebooks covering tokenizers, attention, MoE, RLHF, inference, evaluation, and distillation.

2026 年度顶级开源 AI 工程平台 Qyvaria KernelTop Open-Source AI Engineering Platform 2026 Qyvaria Kernel

cruby 的全能 AI runtime。cruby's capable AI runtime

一款便捷的 lib，用于流畅地与大语言模型（LLM）交互及构建 AI 应用。A handy lib for smooth interaction with large language models (LLMs) and crafting AI apps.

FreeBuff 编码模型的 OpenAI 兼容网关。Token 池、会话生命周期、TLS stealth、嵌入式管理后台。无广告、无 CLI，只有 /v1/chat/completions。OpenAI-compatible gateway for FreeBuff coding models. Token pool, session lifecycle, TLS stealth, embedded admin dashboard. No ads, no CLI, just /v1/chat/completions.

🪢 Langfuse API 的自动生成 Java 客户端。🪢 Auto-generated Java Client for Langfuse API

ELM 是将 LLM 应用于能源研究的一系列工具集合。ELM is a collection of utilities to apply Large Language Models (LLMs) to energy research.

Meta Inc. 所有 oss 模型的相关 recipes。All recipes for oss models from Meta Inc.

repo-map 生成由 LLM 增强的软件仓库摘要与分析，为开发者提供关于项目结构、文件用途以及跨编程语言潜在考量的洞察。repo-map generates LLM-enhanced summaries and analysis of software repositories, providing developers with valuable insights into project structures, file purposes, and potential considerations across various programming languages.

纯 Go 编写的轻量神经网络框架，使用 AVX2 SIMD 内核（GOEXPERIMENT=simd）。A tiny neural-network framework in pure Go with AVX2 SIMD kernels (GOEXPERIMENT=simd)

使用 GPT-3 辅助撰写基金申请书的实验Experiment to use GPT-3 to help write grant proposals.

对人类而言，语言是表达的工具；对 AI 而言，语言是推理的基底。For humans, a language is a tool for expression. For AIs, it's a substrate for reasoning.

AI 原生的结构化数据 wire 格式。在每个前沿模型上实现 100% 理解，比 JSON 减少 50-92% token，跨 17 种格式完成 43B+ 无损往返。Spec v3.4 Stable。The AI-native wire format for structured data. 100% comprehension on every frontier model. 50-92% fewer tokens than JSON. 43B+ lossless round-trips across 17 formats. Spec v3.4 Stable.

精选 AI 模型及其 API 提供商列表，完全无需信用卡即可使用，欢迎贡献！Curated list of AI Models with their API Providers that you never ever require a Credit Card for. Feel free to Contribute!

一个以证据为引领的六语种 LLM 实战手册：包含可迁移的核心、Codex 旗舰路线，以及 ChatGPT、Claude Code、Gemini、DeepSeek 和 Grok 的适配器。An evidence-led, six-language LLM playbook: the transferable core, the Codex flagship track, and adapters for ChatGPT, Claude Code, Gemini, DeepSeek, and Grok.

🦙 使用 Ollama CLI 配置 GitHub Actions。🦙 Set up GitHub Actions with Ollama CLI.

Memory OS CLI 和 npm 包Memory OS CLI and npm package

本地 AI 秘书、技术支持与销售一体化方案，基于 XTTS v2 语音克隆、Vosk/Whisper 实时语音识别与 vLLM + Qwen/Llama 等离线 LLM。配备 Vue 3 完整管理面板、Telegram Bot、网站挂件及 fine-tuning pipeline。支持自托管、数据隐私、短信与电话呼叫。📞 Локальный AI-секретарь, тех. поддержка и менеджер по продажам с клонированием голоса XTTS v2, real-time распознаванием речи (Vosk/Whisper) и offline LLM (vLLM + Qwen/Llama и тп). Полноценная админ-панель (Vue 3), Telegram-бот, виджет для сайта, fine-tuning pipeline. Self-hosted, приватность данных, СМС и телефонные звонки .

运行 Ollama 本地 LLM 服务的 Docker 镜像。默认安全，所有 API 请求需 Bearer token（首次启动时自动生成）。OpenAI 兼容 API。支持首次启动模型预拉取、NVIDIA GPU (CUDA) 加速和持久化模型存储。多架构：amd64、arm64。Docker image to run an Ollama local LLM server. Secure by default, all API requests require a Bearer token (auto-generated on first start). OpenAI-compatible API. Supports first-start model pre-pull, NVIDIA GPU (CUDA) acceleration, and persistent model storage. Multi-arch: amd64, arm64.

💻 在 macOS 上借助 Metal GPU 实现 Qwen3 Transformer 模型，获得加速且高效的性能，并支持关键架构特性💻 Implement Qwen3 transformer model on macOS using Metal GPU for accelerated, efficient performance with support for key architecture features.

Gebo.ai —— 开源、企业级、与 AI 供应商无关的平台Gebo.ai The open source Enterprise AI vendor agnostic platform

以孟加拉语优先、面向方言的 LLM 研究。开源孟加拉语 tokenizer，性能优于 Sarvam、AI4Bharat 和 GPT-4o（fertility 1.52，几乎零破损 conjuncts）。非商用，保护孟加拉语及其方言。Bengali-first, dialect-aware LLM research. Open-source Bengali tokenizer that outperforms Sarvam, AI4Bharat, and GPT-4o (fertility 1.52, near-zero broken conjuncts). Non-commercial, preserving Bengali and its dialects.

🚀 通过 70 个生成式 AI 实战项目转型技能，从入门到生产级架构师，涵盖真实场景应用。🚀 Transform your skills with 70 hands-on projects in Generative AI, guiding you from beginner to production-ready architect with real-world applications.

本仓库包含用于执行不同任务的 Gen AI 项目temThis repository contains Gen AI projects that performs different tasks