msign-stable-rank-restoration

【效率与协作】Prevent unrecoverable gradient explosions in LLM training by periodically restoring weight matrix stable rank through SVD-based matrix sign operations, eliminating sudden training failures without computational burden.

独立 GitHub 快照 · 自动分类 · 以原作者文档为准