Back
Join now
About

Popular Tags

  • react
  • ui-components
  • shadcn-ui
  • tailwind
  • typescript
  • react-components
  • ui-design
  • llm
  • open-source
  • prototyping

Top Sources

  • github.com
  • 1771technologies.com
  • 21st.dev
  • abui.io
  • activepieces.com
  • ai-sdk.dev
  • alchemy.run
  • altsendme.com
  • animate-ui.com
  • ant.design

Browse by Type

  • Tools
  • Code
bookmrks.io - Discovery, refined.
Tags
  • ai-gateway
    1
  • anthropic
    1
  • azure-openai
    1
  • bedrock
    1
  • gateway
    1
  • langchain
    1
  • litellm
    1
  • llm
    1
  • llm-gateway
    1
  • llmops
    1
  • mcp-gateway
    1
  • open-source-coding-agent
    1
  • openai
    1
  • openai-proxy
    1
  • python
    1
  • typescript
    1
  • vertex-ai
    1
Website favicongithub.com
Website preview

LiteLLM: Open Source AI Gateway for 100+ LLMs

LiteLLM is an open-source AI Gateway enabling access to over 100 LLM APIs with features like cost tracking and load balancing.

flux
Tech Stack
OpenAIGCPCloud AI PlatformAzureSentryAnthropicCohere AIReplicateInfisicalRenderGitHubGoDocusaurusReactnpmDockerNode.jsJavaScriptJSXTypeScriptCSSCloudflareCloudflare WorkersHeroiconsRemix IconsLucide IconsPlaywrightHeadless UIAnt DesignNext.jsTesting LibraryESLintPrettierTailwind CSSViteVitestBashPythonMCPJSON SchemaCircleCIPoetryPrismaDependabotGitHub ActionsHelmOpenAPI
Summary

LiteLLM is an open-source AI Gateway designed to facilitate access to over 100 LLM APIs in a unified format. It provides a Python SDK and a proxy server that allows users to call various LLMs using OpenAI-compatible requests.

Key features:

  • Multi-tenant cost tracking - Manage expenses per project or user.
  • Load balancing - Efficiently distribute requests across multiple deployments.
  • Guardrails - Implement safety measures for API usage.
  • Logging and monitoring - Track usage and performance metrics.
  • Customizable virtual keys - Secure access control for users.

LiteLLM is suitable for developers and teams working on generative AI projects, providing a centralized service to access multiple LLMs seamlessly.

Comments
No comments yet. Sign in to add the first comment!