Search
“LLM gateways and routing”
Showing 1–8 of 8 for “LLM gateways and routing”
- 0.860score
Kong AI Gateway
Kong
Cloud-native API, LLM and MCP gateway with multi-LLM routing, AI analytics and an extensible plugin system.
InfrastructureAFreshness: A★ 44.3Kgateway - 0.805score
Apache APISIX AI Gateway
Apache Software Foundation
Open-source API gateway with AI plugins for multi-provider LLM proxying, token limits and observability.
InfrastructureAFreshness: A★ 17.2Kgateway - 0.751score
agentgateway
agentgateway (Linux Foundation)
Open source gateway for HTTP, gRPC, LLM, MCP and agent-to-agent traffic in one data plane.
InfrastructureAFreshness: A★ 5.5Kgateway - 0.594score
Helicone AI Gateway
Helicone
Single OpenAI-compatible API to 100+ LLM providers, with routing, fallbacks and unified observability.
InfrastructureAFreshness: Agateway - 0.597score
Zuplo AI Gateway
Zuplo
AI gateway on the same platform as your APIs, with multi-provider routing, per-team budgets and guardrails.
InfrastructureAFreshness: Agateway - 0.594score
Inference.net
Inference.net
Inference infrastructure for AI teams: hosted open-source and fine-tuned models, plus tracing and evaluation.
InfrastructureAFreshness: Ainference - 0.756score
Plano
Katanemo
AI-native proxy and data plane for agent apps: agent orchestration, LLM routing, guardrails and traces.
InfrastructureAFreshness: A★ 7.1Kgateway - 0.596score
Requesty
Requesty
AI gateway and OpenAI-compatible router for 600+ models, with routing, failover, caching and observability.
InfrastructureAFreshness: Agateway