界面已本地化;技能介绍与说明文档按所选语言由 AI 自动翻译,代码、命令、路径和专业术语保留原文,以原作者文档为准。
探索技能
设计与创意 · SKILL.md

visual_prompt_recovery_harness

visual_prompt_recovery_harness

【设计与创意】Run a bounded mechanism-faithful proxy recovery experiment for visual prompting papers.

独立 GitHub 快照 · 自动分类 · 以原作者文档为准

技能说明

GitHub

name: visual_prompt_recovery_harness description: Run a bounded mechanism-faithful proxy recovery experiment for visual prompting papers.

Visual Prompt Recovery Harness

Use this skill to assemble a fast recovery experiment for Exploring Visual Prompts. The harness should exercise the generated prompt-template, CLIP-output-transformation, and prompt-training skills rather than duplicating their contracts silently. It is suitable for soft-mode proxy recovery when full CLIP training over paper datasets is blocked or too expensive.

Inputs

  • Attempt directory with module_plan.json.
  • Generated skill root.
  • environment/runtime_handoff.json.
  • A tiny synthetic or real classification dataset.

Outputs

  • recovery/recovery_result.json with metric and paper target.
  • recovery/logs/generated_data_item.json.
  • recovery/logs/training_trace.json.
  • recovery/logs/generated_skill_invocations.json.

Workflow

  1. Read the module-plan target instead of hard-coding the paper metric.
  2. Construct the smallest dataset that still needs a universal visual prompt.
  3. Run frozen-model scoring before prompt optimization.
  4. Optimize only prompt parameters and record before/after loss and accuracy.
  5. Cross-check that output transformation uses CLIP-style text prompts/cosine probabilities.
  6. Mark the result as proxy when full CLIP and datasets are not used, and include explicit mechanism checks.

Validation

The included script can be imported by recovery code to compute accuracy gain and write validator-compatible JSON fragments.

Limitations

This skill is not a replacement for a full paper reproduction. It documents a reduced executable recovery when allowed by recovery mode.

我的收藏