Community curated code

QVAC is an open-source SDK for building local, peer-to-peer AI applications across multiple platforms.

AutoRound is a quantization toolkit for LLMs and VLMs, optimizing performance with high accuracy at low bit widths.

Lemonade is a local AI server that allows users to run optimized LLMs on their own hardware, ensuring privacy and cost-effectiveness.

A CLI tool to find and benchmark 200+ free coding models from various AI providers in real-time.

Context7 provides real-time, version-specific documentation for LLMs and coding assistants, enhancing coding efficiency and accuracy.

jcode is a coding agent harness that enhances coding efficiency through advanced features and multi-session workflows.

Bytebot is an AI desktop agent that automates tasks using natural language commands in a self-hosted environment.

Claude Code Router enhances coding by routing requests to multiple AI models, improving developer workflows.
LLPhant is a PHP framework for building applications with generative AI using OpenAI GPT-4, compatible with Symfony and Laravel.
Shimmy is a Rust-based inference server providing local, OpenAI-compatible endpoints for machine learning models.