Popular Tags
No tags found in this context
Community curated code
Shimmy is a Rust-based inference server providing local, OpenAI-compatible endpoints for machine learning models.

Lucebox is a hub for optimized LLM inference tailored for specific consumer hardware, enhancing AI performance and efficiency.