Squirrel LLM Gateway – Open-source proxy to unify and optimize LLM API access

Summary: Squirrel LLM Gateway is an open-source, enterprise-grade proxy that centralizes access to multiple Large Language Model providers. It enables intelligent routing, failover handling, and detailed logging to reduce API costs and simplify model upgrades.

What it does

Squirrel acts as a unified gateway for LLM APIs like OpenAI and Anthropic, using virtual model names to route requests dynamically. It automatically selects the cheapest provider, manages failover without downtime, and logs all API calls including streaming responses.

Who it's for

It is designed for developers and teams managing multiple AI projects who need centralized control over LLM API usage and cost optimization.

Why it matters

Squirrel solves the challenges of costly API usage, complex model upgrades, and limited debugging by providing a single control panel with comprehensive routing and logging capabilities.