omni-moe-atomic-experts

【设计与创意】Scale mixture-of-experts models efficiently by decomposing experts into atomic vector pairs with Cartesian product routing and expert-centric scheduling. Achieves 10.9× speedup and 50% fewer parameters versus fine-grained baselines through system-algorithm codesign that converts scattered memory access into contiguous batched operations.

独立 GitHub 快照 · 自动分类 · 以原作者文档为准