界面已本地化;技能介绍与说明文档按所选语言由 AI 自动翻译,代码、命令、路径和专业术语保留原文,以原作者文档为准。
探索技能
效率与协作 · SKILL.md

proxy_recovery_evaluation

proxy_recovery_evaluation

【效率与协作】Decide whether a declared soft-mode proxy exercises the Accuracy on the Line mechanism.

独立 GitHub 快照 · 自动分类 · 以原作者文档为准

技能说明

GitHub

name: proxy_recovery_evaluation description: Decide whether a declared soft-mode proxy exercises the Accuracy on the Line mechanism.

Proxy Recovery Evaluation

Use this skill after a recovery harness has produced calibration metrics. It evaluates whether a reduced or proxy experiment is acceptable evidence under soft mode. Do not use it to fabricate metrics; it consumes executable experiment outputs.

Inputs

  • A calibration result with pearson_r, slope/intercept, and residuals.
  • A declared target threshold, usually from module_plan.json.fast_recovery_target.paper_value.
  • Mechanism checks covering paired records, line fitting, residual inspection, source boundary, and proxy declaration.

Outputs

  • accepted_proxy, metric_gap, mechanism_ok, and human-readable reasons.
  • A compact JSON decision that analysis can inspect.

Workflow

  1. Confirm the recovery is explicitly declared as proxy evidence.
  2. Check that all required mechanism booleans are true.
  3. Compare the observed Pearson correlation against the declared threshold.
  4. Report metric gap and reasons without upgrading proxy evidence to full reproduction.

Validation

Run the included tests or call python scripts/evaluate_proxy.py --calibration <file> --checks <file> --threshold 0.95.

Limitations

This skill accepts soft-mode proxy evidence only. Hard-mode runs or full benchmark claims require real benchmark results rather than this reduced decision.

我的收藏