pretraining-data-refinement

【文档与办公】Improve pretraining efficiency by refining noisy data through expert-guided programs: learn to generate deletion operations that clean documents, achieving 2.6-7.2% performance gains with fewer training tokens.

独立 GitHub 快照 · 自动分类 · 以原作者文档为准