界面已本地化;技能介绍与说明文档按所选语言由 AI 自动翻译,代码、命令、路径和专业术语保留原文,以原作者文档为准。
探索技能
效率与协作 · SKILL.md

aline_d_estimator

aline_d_estimator

【效率与协作】Solve the ALine-D pairwise linear system to predict OOD accuracies from ID accuracy and unlabeled agreement statistics.

独立 GitHub 快照 · 自动分类 · 以原作者文档为准

技能说明

GitHub

name: aline_d_estimator description: Solve the ALine-D pairwise linear system to predict OOD accuracies from ID accuracy and unlabeled agreement statistics.

ALine-D Estimator

Use this skill after agreement statistics and an agreement-line slope are available. It implements the paper's ALine-D estimator rather than a simple plug-in baseline.

Inputs

  • Statistics JSON from agreement_statistics.
  • Fit JSON from agreement_line_fit.

Outputs

  • Predicted OOD accuracy per model.
  • ALine-S baseline predictions.
  • Equation count and residual diagnostics.

Workflow

  1. Build one linear equation for every unordered model pair.
  2. Use the fitted agreement slope and pairwise agreement terms from Equation (6).
  3. Solve the least-squares system over probit OOD accuracies.
  4. Convert predictions back to probability space.

Validation

Run python tests/test_aline_d_estimator.py from this skill directory.

Limitations

At least three models are required. Rank-deficient synthetic cases may fail because the system cannot identify every model's OOD accuracy.

我的收藏