slime-preference-optimization

【效率与协作】Optimize model preferences by decoupling preference learning from generation quality. Explicitly maximize chosen response likelihood while using token-level stabilization to prevent quality degradation from over-suppressing rejected responses.

独立 GitHub 快照 · 自动分类 · 以原作者文档为准