Popular Tags
No tags found in this context
Top/gguf
The most inspiring discoveries in gguf
github.com
whichllm helps you find the best local LLM for your hardware, optimizing AI inference with real-time benchmarks.
aiapple-siliconbenchmarksclicommand-line-tool
flux
github.com
AutoRound is a quantization toolkit for LLMs and VLMs, optimizing performance with high accuracy at low bit widths.
ggufint4llmllmsmxfp4
flux
github.comShimmy is a Rust-based inference server providing local, OpenAI-compatible endpoints for machine learning models.
api-servercommand-line-tooldeveloper-toolsggufgpt
flux
github.com
llmfit optimizes large language models for your hardware, ensuring efficient performance and compatibility.
ggufllmlocalaimlxopen-source-coding-agent
flux