dynamic-mask-sparse-attention

【效率与协作】Sparse attention mechanism combining content-aware and position-aware sparse patterns through dynamic masking. Achieves 10x speedup while maintaining model quality on long-context benchmarks through hardware-friendly implementation.

独立 GitHub 快照 · 自动分类 · 以原作者文档为准