flash-sampling-efficient-decoding

Fuse categorical sampling directly into LM-head matrix multiplication to eliminate logits materialization. Use Gumbel noise during computation and hierarchical reduction to achieve 19% token-level latency reduction.

Independent GitHub snapshot · Automated classification · Original documentation governs