rl-on-pretraining-data

Scale LLM training using RL on unlabeled pre-training corpora without human annotation. Derive reward signals directly from text segments to optimize both autoregressive generation and in-context reasoning across knowledge and mathematical domains.

Independent GitHub snapshot · Automated classification · Original documentation governs