Code/local-ai

Community curated code

github.com

Dream Server enables self-hosting of AI functionalities on personal hardware, ensuring privacy and control without cloud dependency.

ai-agentsamdcomfyuidockerllama-cpp

flux

github.com

QVAC is an open-source SDK for building local, peer-to-peer AI applications across multiple platforms.

aibare-runtimecppcross-platformembeddings

flux

github.com

Shimmy is a Rust-based inference server providing local, OpenAI-compatible endpoints for machine learning models.

api-servercommand-line-tooldeveloper-toolsggufgpt

flux

github.com

Lucebox is a hub for optimized LLM inference tailored for specific consumer hardware, enhancing AI performance and efficiency.

apple-siliconcppcudakernelllama-cpp

flux