moe-sparsity-reasoning

Determine optimal MoE sparsity by separating memorization and reasoning trade-offs: active FLOPs improve reasoning while total parameters improve memorization, requiring joint optimization

Independent GitHub snapshot · Automated classification · Original documentation governs