standing-committee-moe

【效率与协作】Reveal that Mixture-of-Experts models harbor a 'Standing Committee' of consistent expert coalitions handling majority computational load across domains. Challenges specialization assumptions and suggests training approaches like load-balancing losses may work against natural optimization.

独立 GitHub 快照 · 自动分类 · 以原作者文档为准