sparser-block-attention

【效率与协作】Accelerates self-attention by reordering tokens to concentrate relevant tokens within fewer blocks. Achieves 2.75x speedup on long-context prefilling by permuting tokens so semantically related information clusters together, enabling aggressive block sparsity without accuracy loss.

独立 GitHub 快照 · 自动分类 · 以原作者文档为准