The most inspiring discoveries in llmops

TensorZero is an open-source LLMOps platform unifying API access, observability, evaluation, optimization, and experimentation for large language models.

MLflow is an open source platform for managing AI applications, enabling teams to optimize and monitor production-quality models.
Helicone is an open-source LLM observability platform that enables AI engineers to monitor and evaluate models efficiently.

Langfuse is an open source platform for LLM observability and management, enabling teams to develop and debug AI applications efficiently.

LiteLLM is an open-source AI Gateway enabling access to over 100 LLM APIs with features like cost tracking and load balancing.

Agenta is an open-source platform for building reliable LLM applications with integrated management, evaluation, and observability tools.

Promptfoo is a CLI tool for evaluating and securing LLM applications through automated testing and red teaming.