rlp-reinforcement-pretraining-objective

Improve reasoning during pretraining (not just post-training) by computing rewards from information gain—how much reasoning improves log-likelihood of observed tokens. Works at 1T token scale across diverse corpora.

Independent GitHub snapshot · Automated classification · Original documentation governs