flash-sampling-efficient-decoding

【开发与工程】Fuse categorical sampling directly into LM-head matrix multiplication to eliminate logits materialization. Use Gumbel noise during computation and hierarchical reduction to achieve 19% token-level latency reduction.

独立 GitHub 快照 · 自动分类 · 以原作者文档为准