Popular Tags
No tags found in this context
Community curated code

whichllm helps you find the best local LLM for your hardware, optimizing AI inference with real-time benchmarks.
Shimmy is a Rust-based inference server providing local, OpenAI-compatible endpoints for machine learning models.
RTK is a CLI proxy that reduces LLM token consumption by 60-90%, enhancing developer productivity with minimal overhead.