set-block-decoding-inference-acceleration

Accelerate language model generation 3-5x by combining autoregressive and masked token prediction. Works via fine-tuning—no architectural changes needed. Parallel decode non-consecutive tokens with entropy-bounded sampling.

Independent GitHub snapshot · Automated classification · Original documentation governs