xquant-kv-cache-rematerialization

【效率与协作】Reduce KV cache memory by 7.7-10x through quantization and rematerialization of input activations instead of caching Keys and Values, trading recomputation for memory efficiency.

独立 GitHub 快照 · 自动分类 · 以原作者文档为准