lychee-decode-sparse-kv-sharing

Classify attention heads into retrieval (full attention) and sparse (token-selected) roles using HardKuma distribution for differentiable discrete optimization. Sparse heads reuse KV pairs from retrieval heads, reducing cache by 90% while maintaining quality through joint training.

Independent GitHub snapshot · Automated classification · Original documentation governs