block-ffn-sparse-mixture-experts

Deploy efficient MoE models on resource-constrained edge devices by learning chunk-level activation sparsity that achieves 3.67× speedup. Use when you need to compress LLMs for on-device inference while maintaining reasoning quality and supporting speculative decoding acceleration.

Independent GitHub snapshot · Automated classification · Original documentation governs