sparselora-contextual-sparsity-finetuning

【效率与协作】Accelerates LoRA fine-tuning 2.2× computationally and 1.6× wall-clock by leveraging contextual sparsity to compute gradients only for important weight channels. Uses training-free SVD sparsity estimation without full computation. Apply for efficient fine-tuning on memory-constrained GPUs or large-scale training scenarios.

独立 GitHub 快照 · 自动分类 · 以原作者文档为准