界面已本地化;技能介绍与说明文档按所选语言由 AI 自动翻译,代码、命令、路径和专业术语保留原文,以原作者文档为准。
探索技能
开发与工程 · SKILL.md

rnd_proxy_recovery_harness

rnd_proxy_recovery_harness

【开发与工程】Run a bounded Random Network Distillation proxy recovery experiment with executable evidence and generated-skill invocation logs.

独立 GitHub 快照 · 自动分类 · 以原作者文档为准

技能说明

GitHub

name: rnd_proxy_recovery_harness description: Run a bounded Random Network Distillation proxy recovery experiment with executable evidence and generated-skill invocation logs.

RND Proxy Recovery Harness

Use this skill when full Atari-scale RND training is blocked by runtime cost but soft-mode recovery permits a reduced, mechanism-faithful proxy. The harness should reproduce the paper's MNIST-style novelty intuition: a predictor distills a deterministic random target, and held-out target-class error decreases when more target examples are included.

Inputs

  • Attempt directory containing module_plan.json and generated skills.
  • Runtime handoff JSON from environment preparation.
  • Generated RND module skill paths.

Outputs

  • recovery/recovery_result.json with novelty_mse_reduction_fraction.
  • recovery/logs/training_trace.json with loss and parameter changes.
  • recovery/logs/generated_data_item.json describing proxy data.
  • recovery/logs/generated_skill_invocations.json proving module usage.

Workflow

  1. Read the module-plan target and runtime handoff.
  2. Create deterministic synthetic vectors for a frequent seen class and an under-sampled target class.
  3. Normalize observations via rnd_observation_normalization.
  4. Train a predictor against a frozen random target via rnd_bonus_model in low-target and high-target regimes.
  5. Cross-check reward scaling and dual-return contracts with their generated skill scripts.
  6. Write recovery artifacts and mechanism checks, marking the result as proxy/reduced.
  7. Run the recovery experiment validator after the command completes.

Validation

Run python scripts/run_proxy_recovery.py --attempt-dir <attempt_dir> --skills-root <generated_skills_root>. The command should produce all recovery artifacts and a positive reduction fraction.

Limitations

This is not full Atari PPO training and must not be reported as full reproduction. It is acceptable only under soft recovery mode after recording the full-runtime blocker.

我的收藏