Hosted LiteLLM Proxy
LiteLLM maintains the proxy, so you can focus on your core products.
Get Onboarded​
This is in alpha. Schedule a call with us, and we'll give you a hosted proxy within 30 minutes.
Status: Alpha​
Our proxy is already used in production by customers.
See our status page for live reliability
Benefits​
- No Maintenance, No Infra: We'll maintain the proxy, and spin up any additional infrastructure (e.g.: separate server for spend logs) to make sure you can load balance + track spend across multiple LLM projects.
- Reliable: Our hosted proxy is tested on 1k requests per second, making it reliable for high load.
- Secure: LiteLLM is currently undergoing SOC-2 compliance, to make sure your data is as secure as possible.
Pricing​
Pricing is based on usage. We can figure out a price that works for your team, on the call.
Screenshots​
1. Create keys​
2. Add Models​
3. Track spend​
4. Configure load balancing​
