sparsemm-visual-attention

【设计与创意】Discovers that <5% of attention heads process visual information in MLLMs; introduces SparseMM for asymmetric KV-cache allocation achieving 1.38x acceleration and 52% memory reduction.

独立 GitHub 快照 · 自动分类 · 以原作者文档为准