The most inspiring discoveries in nvfp4
AutoRound is a quantization toolkit for LLMs and VLMs, optimizing performance with high accuracy at low bit widths.