BerriAI/litellm

  • 类型:github
  • 标识:BerriAI/litellm
  • 链接:https://github.com/BerriAI/litellm
  • 主题:llm-infra
  • 主分类:llm-infra
  • 形态:library
  • 分类:trending
  • Stars:56075
  • 周增:+259
  • 语言:Python
  • 许可:NOASSERTION
  • 最近提交:2026-08-11
  • 简介:The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
  • 上次采集:2026-08-11
  • 简介中文:Python SDK、代理服务器(AI Gateway),以 OpenAI(或原生)格式调用 100+ LLM API,支持成本追踪、guardrails、负载均衡和日志记录。[Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]
  • 副分类:risk
  • 待LLM分类:否
  • 成熟度:production
  • 首次采集:2026-06-30
  • 来源文件
  • [GitHub Search]