sparsemm-visual-attention

Discovers that <5% of attention heads process visual information in MLLMs; introduces SparseMM for asymmetric KV-cache allocation achieving 1.38x acceleration and 52% memory reduction.

Independent GitHub snapshot · Automated classification · Original documentation governs