Popular Tags
No tags found in this context
Community curated code

AutoRound is a quantization toolkit for LLMs and VLMs, optimizing performance with high accuracy at low bit widths.
Shimmy is a Rust-based inference server providing local, OpenAI-compatible endpoints for machine learning models.