learnable-multipliers-lm-scaling

【数据与研究】Adapt language model weight matrix scales automatically during training by adding learnable scalar and vector multipliers to each layer. Breaks the noise-weight-decay equilibrium that constrains scales based on hyperparameters rather than data, enabling data-driven scaling adaptation without inference cost or extensive tuning overhead.

独立 GitHub 快照 · 自动分类 · 以原作者文档为准