Litellm
AI
Call all LLM APIs using the OpenAI format. Use Bedrock, Azure, OpenAI, Cohere, Anthropic, Ollama, Sagemaker, HuggingFace, Replicate, Groq (100+ LLMs)
What you get
- One-click deploy into any active package
- Free SSL certificate on your subdomain
- Live logs, health status and usage meters
- Start, stop and restart from the panel
- Email alerts if the app goes down
Related apps
Run Litellm on WeServer.
Create an account and deploy this app in minutes.