Popular Tags
No tags found in this context
Top/efficient-inference
The most inspiring discoveries in efficient inference
github.com
Orthrus is a framework for efficient parallel token generation in LLMs, ensuring lossless output and significant speed improvements.
diffusion-language-modelsefficient-inferencelarge-language-modelsllmllm-efficiency
flux