界面已本地化;技能介绍与说明文档按所选语言由 AI 自动翻译,代码、命令、路径和专业术语保留原文,以原作者文档为准。
探索技能
效率与协作 · SKILL.md

reduced_recovery_evaluator

reduced_recovery_evaluator

【效率与协作】Assemble executable soft-mode proxy recovery results with metrics, traces, and mechanism checks.

独立 GitHub 快照 · 自动分类 · 以原作者文档为准

技能说明

GitHub

name: reduced_recovery_evaluator description: Assemble executable soft-mode proxy recovery results with metrics, traces, and mechanism checks.

Reduced Recovery Evaluator

Use this skill after a bounded proxy experiment has run and needs to emit Distiller-compatible evidence. It is designed for soft-mode recovery where full paper reproduction is blocked by data or compute limits.

Inputs

  • Paper target metadata from module_plan.json.
  • Numeric proxy metrics and command strings.
  • Mechanism-check booleans, generated skill invocations, and training trace paths.

Outputs

  • A recovery result dictionary with is_proxy, numeric metrics, target metadata, commands, artifacts, and mechanism checks.
  • Consistency checks for reduced training traces.

Workflow

  1. Copy the paper target from the module plan rather than inventing a new target.
  2. Record proxy status and sample count explicitly.
  3. Include mechanism checks for protocol validation, augmentation, comparison, loss reduction, and optimizer updates.
  4. Verify that reduced optimizer claims are backed by changed parameters and loss values.

Validation

Run python tests/test_evaluator.py or the Distiller skill validator.

Limitations

This skill formats and checks recovery evidence. It does not by itself run the training experiment.

我的收藏