token-sparse-attention-long-context

Dynamically select important tokens at the attention head level, performing dense attention only on selected tokens and scattering results back. Achieves 3.23x attention speedup at 128K context with 1% accuracy loss through layer-wise representation stability analysis.

Independent GitHub snapshot · Automated classification · Original documentation governs