Ling-3.0-tiny-UBTree
26 downloads
0 likes
on ModelScope
updated
Papers using or citing this model 1
-
UBTree: Parallel Tree Drafting via Unigram and Bigram Models for Speculative Decoding
Speculative decoding accelerates language model inference by verifying multiple draft tokens in a single target-model pass. Recent parallel drafters have achieved breakthrough performance in frontier production models, but their...