pretrain-zero-active-pretraining

Bilevel min-max optimization where mask generator selects informative spans from pretraining data and mask predictor recovers them via chain-of-thought, enabling effective RL pretraining on noisy corpora without supervised fine-tuning.

Independent GitHub snapshot · Automated classification · Original documentation governs