mapo-mixed-advantage-policy-optimization

Dynamically reweight advantage functions based on trajectory certainty to improve policy optimization in foundation models. Addresses advantage reversion and mirror problems by mixing standardized and mean-normalized advantage formulations. Enables more stable gradient signals across high- and low-certainty samples.

Independent GitHub snapshot · Automated classification · Original documentation governs