界面已本地化;技能介绍与说明文档按所选语言由 AI 自动翻译,代码、命令、路径和专业术语保留原文,以原作者文档为准。
探索技能
效率与协作 · SKILL.md

reprogramming_evaluation

reprogramming_evaluation

【效率与协作】Validate mechanism evidence for adversarial reprogramming proxy or full recovery experiments.

独立 GitHub 快照 · 自动分类 · 以原作者文档为准

技能说明

GitHub

name: reprogramming_evaluation description: Validate mechanism evidence for adversarial reprogramming proxy or full recovery experiments.

Mechanism-Faithful Reprogramming Evaluation

Use this skill after a recovery run to check whether it exercised the paper mechanism: frozen target model, universal input program, output remapping, optimizer update, numeric metric, and clean source boundary. Do not accept a high metric if these mechanism checks are missing.

Inputs

  • Recovery result dictionary.
  • Training trace dictionary.
  • Optional source manifest paths.

Outputs

  • ok boolean.
  • List of errors.
  • Metric and mechanism summary.

Workflow

  1. Verify at least one numeric metric.
  2. Verify required mechanism booleans.
  3. For reduced/proxy recovery, verify parameter change and loss fields.
  4. Verify forbidden original repository paths are absent from the source manifest.

Validation

Run python tests/test_reprogramming_evaluation.py.

Limitations

This helper evaluates artifact consistency. It does not independently re-run the recovery experiment.

我的收藏