Code/llm

github.com

Shimmy is a Rust-based inference server providing local, OpenAI-compatible endpoints for machine learning models.

github.com

Translate books and documents using AI with no size limits, preserving formatting and context.

github.com

LangExtract is a Python library for extracting structured data from unstructured text using LLMs, offering precise source grounding and visualization.

github.com

Prompt Optimizer enhances AI prompts for better results, supporting multiple platforms and advanced features for secure and efficient usage.

github.com

Pydantic AI is a Python framework for building robust generative AI applications with seamless observability and type safety.

github.com

Memori is a memory infrastructure that enhances AI interactions by providing persistent state management and seamless integration.

github.com

MLflow is an open source platform for managing AI applications, enabling teams to optimize and monitor production-quality models.

github.com

llmfit optimizes large language models for your hardware, ensuring efficient performance and compatibility.

github.com

RTK is a CLI proxy that reduces LLM token consumption by 60-90%, enhancing developer productivity with minimal overhead.

github.com

GoModel is a lightweight AI gateway that integrates multiple AI services through a unified API, enhancing accessibility and usability.