The most inspiring discoveries in transformers
Shimmy is a Rust-based inference server providing local, OpenAI-compatible endpoints for machine learning models.