scaling-laws-optimal-data-mixtures

Predict optimal data mixture proportions for multi-domain LLM training using scaling laws that require only 10-20 small experiments. Determine which domains should contribute how much data across model sizes (186M-7B), reducing computational waste in foundation model pretraining.

Independent GitHub snapshot · Automated classification · Original documentation governs