界面已本地化;技能介绍与说明文档按所选语言由 AI 自动翻译,代码、命令、路径和专业术语保留原文,以原作者文档为准。
探索技能
效率与协作 · SKILL.md

msfm_mechanism_evaluation

msfm_mechanism_evaluation

【效率与协作】Evaluate whether an MSFM recovery result exercised BatchOT coupling, Joint CFM loss, optimizer evidence, and soft-mode proxy constraints.

独立 GitHub 快照 · 自动分类 · 以原作者文档为准

技能说明

GitHub

name: msfm_mechanism_evaluation description: Evaluate whether an MSFM recovery result exercised BatchOT coupling, Joint CFM loss, optimizer evidence, and soft-mode proxy constraints.

MSFM Mechanism Evaluation

Use this skill after a Multisample Flow Matching recovery experiment has produced recovery_result.json, training_trace.json, and generated skill invocation logs.

Do not accept a proxy run only because its metric is positive; this skill checks whether the recovery exercised the paper mechanisms and respected source/runtime boundaries.

Inputs

  • Recovery result JSON.
  • Training trace JSON.
  • Generated skill invocation log.
  • Optional minimum transport-cost reduction threshold.

Outputs

  • Mechanism pass/fail report.
  • Metric gap summary.
  • Refinement hints assigned to module-level causes.

Workflow

  1. Confirm proxy status is declared when full recovery is not claimed.
  2. Verify BatchOT and uniform couplings were evaluated and double-stochastic evidence passed.
  3. Verify Joint CFM loss and an optimizer step were executed.
  4. Verify reduced/full booleans are honest and no original repository was read.
  5. Confirm generated skill invocations cover coupling, loss, recovery, and evaluation modules.
  6. Return actionable hints for missing mechanism evidence.

Validation

Run:

python scripts/evaluate_mechanism.py --self-test
python tests/test_evaluate_mechanism.py

Limitations

  • This skill evaluates reduced/proxy mechanism evidence; it does not compare full ImageNet FID.
我的收藏