界面已本地化;技能介绍与说明文档按所选语言由 AI 自动翻译,代码、命令、路径和专业术语保留原文,以原作者文档为准。
探索技能
效率与协作 · SKILL.md

coherence_alpha_selection

coherence_alpha_selection

【效率与协作】Select a coherence boosting alpha from cached validation likelihoods without model finetuning.

独立 GitHub 快照 · 自动分类 · 以原作者文档为准

技能说明

GitHub

name: coherence_alpha_selection description: Select a coherence boosting alpha from cached validation likelihoods without model finetuning.

Coherence Alpha Selection

Use this skill when validation examples contain full-context and premise-free candidate log likelihoods and labels. It implements the paper's one-pass validation-grid choice of alpha.

Inputs

  • Validation records with full_logprobs, short_logprobs, and label.
  • A numeric alpha grid.

Outputs

  • Best alpha, accuracy curve, and deterministic tie-breaking notes.

Workflow

  1. For each alpha, call the boosted scoring rule.
  2. Compute validation accuracy.
  3. Choose the highest accuracy; ties prefer the alpha with smaller absolute value, then smaller numeric value for reproducibility.
  4. Return the full curve for audit.

Validation

Run tests/test_alpha_selection.py.

Limitations

The skill assumes likelihoods have already been computed by a frozen LM or a declared proxy scorer.

我的收藏