Popular Tags
No tags found in this context
Code/inference-server
Community curated code
github.comShimmy is a Rust-based inference server providing local, OpenAI-compatible endpoints for machine learning models.
api-servercommand-line-tooldeveloper-toolsggufgpt
flux
github.comoMLX is an LLM inference server optimized for Apple Silicon, enabling efficient model management from the macOS menu bar.
apple-siliconinference-serverllmmacosmlx
flux