April 28, 2025: This article has been updated to reflect the availability of Llama 4 models in Amazon Bedrock. The availability of Llama 4 Scout and Llama 4 Maverick on AWS expand the already broad ...
An open-source, high-performance gateway unifying multiple LLM providers, from local solutions like Ollama to major cloud providers such as OpenAI, Groq, Cohere, Anthropic, Cloudflare and DeepSeek.