mu-parametrization-moe

【效率与协作】Apply μ-parametrization to Mixture-of-Experts architectures to enable reliable hyperparameter transfer across model sizes, eliminating costly retuning when scaling to trillion-parameter systems.

独立 GitHub 快照 · 自动分类 · 以原作者文档为准