The most inspiring discoveries in sglang
AutoRound is a quantization toolkit for LLMs and VLMs, optimizing performance with high accuracy at low bit widths.