Code/glm

Community curated code

github.com

High-Performance Framework for Language Models

SGLang is an open-source framework for efficient serving of large language and multimodal models, ensuring low-latency and high-throughput performance.

attentionblackwellcudadeepseekdiffusion

flux

github.com

High-Performance Inference Engine for LLMs

xLLM is an efficient inference engine for large language models, optimized for AI accelerators, enabling cost-effective enterprise deployment.

cppdeepseekglminferenceinference-engine

flux