Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq]
21.6k
Stars
2.8k
Forks
1.3k
Issues
519
Contributors
113
Watchers
anthropiclangchainllmllmopsopenaiai-gatewayazure-openaibedrockgatewayopenai-proxyvertex-aillm-gateway
Python
{"name":"Other","spdxId":"NOASSERTION"}
Project Description
A tool to simplify the API calls of large models. This project can unify the interfaces of various AI large models and services into the format of OpenAI, simplifying the work of switching and managing different AI services/large models. In addition, it also supports setting budgets, limiting request frequencies, managing API keys, and configuring OpenAI proxy servers, among other functions.