

Portkey AI Gateway
Overview :
Portkey's AI Gateway serves as an interface between applications and hosted LLMs. It optimizes API requests to OpenAI, Anthropic, Mistral, Llama2, Anyscale, Google Gemini, and more through a unified API, achieving smooth routing. This gateway is fast, lightweight, with an in-built retry mechanism, supporting multi-model load balancing to ensure application reliability and performance.
Target Users :
["Utilizes a unified API to access various LLMs","Enhances application stability","Optimizes usage of different LLMs","Seamlessly migrates to new LLMs"]
Use Cases
Invoke different LLMs via the gateway using the OpenAI SDK
Configure failover strategies to prevent request failures
Configure multiple API keys for applications to implement load balancing
Features
Unified API Signature
Multi-model Support
Auto-retry
Load Balancing
Fault Tolerant Backup
Featured AI Tools

One Api
one-api is an open-source OpenAI interface management and distribution system. It supports a variety of large models, including Azure, Anthropic Claude, Google PaLM 2 & Gemini, Zhipu ChatGLM, Baidu Wenxin Yiyan, Xunfei 星火 Cognitive, Alibaba Tongyi Qianwen, 360 ZhiNao, and Tencent Hymenaeum, among others. It can be used for secondary distribution management of keys, is a single executables package ready for use, and comes with pre-packaged Docker images for easy one-click deployment.
AI API tools and services
297.8K

Openapi Ui
openapi-ui is a more concise and beautiful OpenAPI documentation website than Swagger UI. It can quickly generate simulated parameters and call API requests, and it is also a simplified version of Postman.
AI API tools and services
197.9K