最快的 enterprise AI gateway(比 LiteLLM 快 50 倍),具备自适应负载均衡、集群模式、guardrails,支持 1000+ 模型,在 5k RPS 下额外开销 <100 µs。Fastest enterprise AI gateway (50x faster than LiteLLM) with adaptive load balancer, cluster mode, guardrails, 1000+ models support & <100 µs overhead at 5k RPS.
仓库/Skill 库
591 个 · 应用 · AI 核心
Plano 是面向 agentic 应用的 AI 原生代理与数据平面,内置编排、安全、可观测性和智能 LLM 路由,让你专注于 agent 核心逻辑。Plano is an AI-native proxy server and data plane for agentic apps. Smart LLM routing, observability, agent orchestration, and guardrails so you stay focused on your agents core logic.
ClearML —— 以自动化 CI/CD 简化 AI 工作负载。一站式 MLOps/LLMOps 解决方案,涵盖实验管理、数据管理、pipeline、编排、调度与服务。ClearML - Auto-Magical CI/CD to streamline your AI workload. Experiment Management, Data Management, Pipeline, Orchestration, Scheduling & Serving in one MLOps/LLMOps solution
面向 Apple Silicon 的端侧语音 AI。On-device Speech AI for Apple Silicon
AI Agent 治理工具包 —— 提供策略执行、零信任身份、运行沙箱与可靠性工程,覆盖 OWASP Agentic Top 10 全部 10 项。AI Agent Governance Toolkit — Policy enforcement, zero-trust identity, execution sandboxing, and reliability engineering for autonomous AI agents. Covers 10/10 OWASP Agentic Top 10.
Chronos:面向时间序列预测的预训练模型Chronos: Pretrained Models for Time Series Forecasting
LLM 实战指南:从基础到使用 LLMOps 最佳实践将 LLM 和 RAG 应用部署到 AWSThe LLM's practical guide: From the fundamentals to deploying advanced LLM and RAG apps to AWS using LLMOps best practices
🏝️ OASIS:基于一百万 Agent 的开放社交交互仿真。🏝️ OASIS: Open Agent Social Interaction Simulations with One Million Agents.
面向常驻 Agent 的开源个人云操作系统。Open-Source Personal Cloud OS for Always-On Agents
面向 monorepo 的终极 RAG。借助 AI 与知识图谱的能力,对多语言代码库进行查询、理解与编辑。The ultimate RAG for your monorepo. Query, understand, and edit multi-language codebases with the power of AI and knowledge graphs
【三年面试五年模拟】AIGC/LLM/AI Agent算法工程师面试资源平台。涵盖AIGC、LLM大模型、AI Agent、具身智能、传统深度学习、计算机视觉、自然语言处理、自动驾驶、机器学习、强化学习、大数据挖掘、世界模型、元宇宙、AGI等AI行业面试笔试干货经验与核心跨周期知识。
终端中的 Agent,配备本地工具:编写代码、使用终端、浏览网页。在其之上构建你自己的持久化自主 Agent。Your agent in your terminal, equipped with local tools: writes code, uses the terminal, browses the web. Make your own persistent autonomous agent on top!
免费学习如何使用 LLMOps 最佳实践构建端到端生产级 LLM & RAG 系统:源码 + 12 个实操课程。🤖 𝗟𝗲𝗮𝗿𝗻 for 𝗳𝗿𝗲𝗲 how to 𝗯𝘂𝗶𝗹𝗱 an end-to-end 𝗽𝗿𝗼𝗱𝘂𝗰𝘁𝗶𝗼𝗻-𝗿𝗲𝗮𝗱𝘆 𝗟𝗟𝗠 & 𝗥𝗔𝗚 𝘀𝘆𝘀𝘁𝗲𝗺 using 𝗟𝗟𝗠𝗢𝗽𝘀 best practices: ~ 𝘴𝘰𝘶𝘳𝘤𝘦 𝘤𝘰𝘥𝘦 + 12 𝘩𝘢𝘯𝘥𝘴-𝘰𝘯 𝘭𝘦𝘴𝘴𝘰𝘯𝘴
面向 AI Agent 的开发者控制平面Developer Control Plane for your AI Agents
在 Kubernetes 上借助现代加速器实现 SOTA 推理性能。Achieve state of the art inference performance with modern accelerators on Kubernetes
可扩展至上千个微调 LLM 的 Multi-LoRA 推理服务器Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs
由 AI 驱动的虚拟高管团队 —— 单一连贯的高管 persona,由 8 个 Claude 专家 agent 支撑(FastAPI + Next.js)。AI-powered virtual executive team — a single coherent executive persona backed by 8 specialist Claude agents (FastAPI + Next.js).
面向 AI Agents 的统一虚拟文件系统。The World's First Unified Virtual Filesystem For AI Agents
⚡FlashRAG:面向高效 RAG 研究的 Python 工具包(WWW2025 Resource)⚡FlashRAG: A Python Toolkit for Efficient RAG Research (WWW2025 Resource)
面向 LLM 实验和 AI Agent 的评估与追踪Evaluation and Tracking for LLM Experiments and AI Agents
ReMe:面向 Agent 的记忆管理工具包——Remember Me, Refine Me.ReMe: Memory Management Kit for Agents - Remember Me, Refine Me.
NVIDIA 产品的 Agent Skills — 安装到 Claude Code、Codex 和其他编码 Agent 中,端到端运行 Physical AI、机器人、仿真、CUDA 和 RAG 工作流。Agent Skills for NVIDIA products — install into Claude Code, Codex, and other coding agents to run Physical AI, robotics, simulation, CUDA, and RAG workflows end to end.
AI Agent 的通用记忆层。提供可扩展、可互操作的记忆存储与检索,为下一代自主系统简化 AI agent 状态管理。Universal memory layer for AI Agents. It provides scalable, extensible, and interoperable memory storage and retrieval to streamline AI agent state management for next-generation autonomous systems.
面向编码 Agent 的通用 Playwright 自动化。General-purpose Playwright automation for coding agents
PyTorch 原生的量化和稀疏化方案,支持训练与推理PyTorch native quantization and sparsity for training and inference
学习使用 LLM、agent、RAG、微调、LLMOps 和 AI 系统技术构建你的 Second Brain AI 助手。Learn to build your Second Brain AI assistant with LLMs, agents, RAG, fine-tuning, LLMOps and AI systems techniques.
缺失的开源 Kubernetes UI,内置 MCP 服务器,面向 AI Agent。可查看故障、原因及变更。Issues、Topology、事件时间线、Helm、GitOps、实时服务流量和集群审计——全部打包在一个 Go 二进制文件中。The missing open-source Kubernetes UI with a built-in MCP server for AI agents. See what's broken, why, and what changed. Issues, Topology, event timeline, Helm, GitOps, live service traffic, and cluster audits - all in one Go binary.
开源推理服务器与生产级集群,支持 Agent 所需的全部模型Open-source inference server and production cluster for all the models your agent needs.
为 vLLM 在 Ascend 上的社区维护硬件插件Community maintained hardware plugin for vLLM on Ascend
像构建 API 和微服务一样构建、运行和扩展 AI Agent。Build, run and scale AI agents like API and microservices
RAG 领域新 SOTA —— 一种全新的原创检索架构,以及面向人类与 Agent 的开源知识库。A new SOTA for RAG — an original retrieval architecture and an open-source knowledge base for humans and agents.
构建可自主决策的应用(chatbot、agent、simulation 等)。支持在你的基础设施上进行监控、追踪、持久化与执行。Build applications that make decisions (chatbots, agents, simulations, etc...). Monitor, trace, persist, and execute on your own infrastructure.