set-block-decoding-inference-acceleration

【开发与工程】Accelerate language model generation 3-5x by combining autoregressive and masked token prediction. Works via fine-tuning—no architectural changes needed. Parallel decode non-consecutive tokens with entropy-bounded sampling.

独立 GitHub 快照 · 自动分类 · 以原作者文档为准