leank-kv-cache-pruning

【效率与协作】Learning-based approach to reduce key-value cache memory during inference through static channel-wise sparsity masks. Achieves 70% K cache and 16-18% V cache memory reduction with 1.3x attention speedup.

独立 GitHub 快照 · 自动分类 · 以原作者文档为准