LITELLM

Downloadable software development kits (SDK); Downloadable computer software for calling large language model (LLM) application programming interfaces (API) in specific unified API format; spend tracking for LLM requests; creating virtual keys allowing user authentication; setting budget limits, rate limits, and emitting logs for other logging destinations and/or observability providers; load balancing, fallbacks, and retries

Software as a service (SAAS) services featuring software for calling large language model (LLM) application programming interfaces (API) in specific API format; spend tracking for LLM requests; creating virtual keys allowing user authentication; setting budget limits, rate limits, and emitting logs for other logging destinations and/or observability providers; load balancing, fallbacks, and retries; Providing online non-downloadable computer software platforms for calling large language model (LLM) application programming interfaces (API) in specific unified API format; spend tracking for LLM requests; creating virtual keys allowing user authentication; setting budget limits, rate limits, and emitting logs for other logging destinations and/or observability providers; load balancing, fallbacks, and retries