pretrain-zero-active-pretraining

【数据与研究】Bilevel min-max optimization where mask generator selects informative spans from pretraining data and mask predictor recovers them via chain-of-thought, enabling effective RL pretraining on noisy corpora without supervised fine-tuning.

独立 GitHub 快照 · 自动分类 · 以原作者文档为准