slime-preference-optimization

Optimize model preferences by decoupling preference learning from generation quality. Explicitly maximize chosen response likelihood while using token-level stabilization to prevent quality degradation from over-suppressing rejected responses.

Independent GitHub snapshot · Automated classification · Original documentation governs