Laguna-XS-2.1-DFlash
54 downloads
0 likes
on Hugging Face
updated
Papers using or citing this model 1
-
DFlash: Block Diffusion for Flash Speculative Decoding
Autoregressive large language models (LLMs) deliver strong performance but require inherently sequential decoding, leading to high inference latency and poor GPU utilization. Speculative decoding mitigates this bottleneck by using a...