rlp-reinforcement-pretraining-objective

【效率与协作】Improve reasoning during pretraining (not just post-training) by computing rewards from information gain—how much reasoning improves log-likelihood of observed tokens. Works at 1T token scale across diverse corpora.

独立 GitHub 快照 · 自动分类 · 以原作者文档为准