Popular Tags
No tags found in this context
Code/llm-inference
Community curated code
github.comShimmy is a Rust-based inference server providing local, OpenAI-compatible endpoints for machine learning models.
api-servercommand-line-tooldeveloper-toolsggufgpt
flux
github.com
xLLM is an efficient inference engine for large language models, optimized for AI accelerators, enabling cost-effective enterprise deployment.
cppdeepseekglminferenceinference-engine
flux