Awesome AI Gateway

Vercel AI Gateway

Vercel AI Gateway  is a proxy service from Vercel that routes model requests to various AI providers. It offers a unified API to multiple providers and gives you the ability to set budgets, monitor usage, load-balance requests, and manage fallbacks.

Cloudflare AI Gateway

Cloudflare AI Gateway  provides centralized visibility and control for your AI applications. Connect your apps with a single line of code to monitor usage, costs, and errors. Reduce risks and expenses through caching, rate limiting, request retries, and model fallbacks. Ensure reliability, scalability, and productivity with minimal effort.

Helicone

open-source

Saas

Helicone  is the open-source LLM observability platform for developers to monitor, debug, and improve production-ready applications.