flexible-data-mixture-of-experts

Train language models where each expert learns independently on closed datasets, enabling flexible inference with selective data inclusion or exclusion. 41% performance improvement while allowing users to opt out of specific data sources without retraining.

Independent GitHub snapshot · Automated classification · Original documentation governs