界面已本地化;技能介绍与说明文档按所选语言由 AI 自动翻译,代码、命令、路径和专业术语保留原文,以原作者文档为准。
探索技能
效率与协作 · SKILL.md

opal_recovery_evaluation

opal_recovery_evaluation

【效率与协作】Validate OPAL recovery evidence, mechanism checks, source boundaries, and proxy metric comparison.

独立 GitHub 快照 · 自动分类 · 以原作者文档为准

技能说明

GitHub

name: opal_recovery_evaluation description: Validate OPAL recovery evidence, mechanism checks, source boundaries, and proxy metric comparison.

OPAL Recovery Evaluation

When To Use

Use this skill after a recovery harness produces OPAL metrics. It checks whether the result is a mechanism-faithful OPAL recovery rather than a generic controller success.

Inputs

  • Module-plan target metadata.
  • Recovery result JSON.
  • Generated skill invocation evidence.
  • Source manifest and experiment command log.

Outputs

  • Evaluation summary with metric gap and mechanism status.
  • Boolean pass/fail for proxy acceptance checks.

Workflow

  1. Confirm the recovered target metadata matches the module plan target.
  2. Confirm the source manifest excludes the original repository.
  3. Require numeric metrics and command evidence.
  4. For proxy recovery, require mechanism booleans for segmentation, primitive learning, optimizer updates, latent relabeling, and high-level control.
  5. Report gap between proxy metric and paper table value without pretending the proxy is full D4RL reproduction.

Validation

Run:

python tests/test_recovery_evaluation.py

Limitations

This skill validates evidence structure and OPAL mechanism coverage. It does not replace the Distiller recovery gate.

我的收藏