支持 30+ LLM(OpenAI、Anthropic、Bedrock、Azure 等)的统一 AI 网关,具备缓存、Guardrails、A/B 测试与成本控制能力。Go 原生、速度最快且可扩展的 AI 网关,可替代 LiteLLM 与 Kong AI GatewayUnified AI Gateway for 30+ LLMs (OpenAI, Anthropic, Bedrock, Azure etc) with Caching, Guardrails, A/B test & cost controls. Go-native Fastest & Scalable AI Gateway LiteLLM & Kong AI Gateway alternative.
llm-infra