lookaheadkv-predictive-cache-eviction

Evict unnecessary KV cache entries using trainable lookahead tokens and LoRA modules that predict token importance without drafting responses. Achieve 14.5× speedup over draft-based methods with 2% eviction overhead.

Independent GitHub snapshot · Automated classification · Original documentation governs