llada2-diffusion-scaling

【文档与办公】Convert pre-trained autoregressive models into large-scale diffusion language models via Warmup-Stable-Decay training strategy. Progressively increase block size during warmup, perform stable diffusion training, then decay to smaller blocks for inference. Achieve 535 tokens-per-second with document-level masking and confidence-aware training.

独立 GitHub 快照 · 自动分类 · 以原作者文档为准