margin-adaptive-dpo

Adapt DPO temperature parameters per sample using reward model margins, amplifying learning signals for hard preference pairs while dampening easy ones.

Independent GitHub snapshot · Automated classification · Original documentation governs