界面已本地化;技能介绍与说明文档按所选语言由 AI 自动翻译,代码、命令、路径和专业术语保留原文,以原作者文档为准。
探索技能
效率与协作 · SKILL.md

weaning_schedule

weaning_schedule

【效率与协作】Compute QDagger teacher-distillation coefficient schedules for weaning a value student off a suboptimal teacher.

独立 GitHub 快照 · 自动分类 · 以原作者文档为准

技能说明

GitHub

name: weaning_schedule description: Compute QDagger teacher-distillation coefficient schedules for weaning a value student off a suboptimal teacher.

Weaning Schedule

When To Use

Use this skill when a PVRL or QDagger implementation needs the current coefficient on teacher-policy distillation. It is specifically for methods that should reduce teacher dependence over training. Do not use a fixed positive coefficient when the experiment claims QDagger-style weaning.

Inputs

  • lambda_0: initial nonnegative teacher-distillation coefficient.
  • Linear schedule inputs: step and decay_steps.
  • Performance schedule inputs: student_score and teacher_score.

Outputs

  • lambda_t: current nonnegative coefficient.
  • progress: clipped progress or performance ratio.
  • schedule: selected schedule type.

Workflow

  1. Choose linear_decay for step-based experiments or performance_decay when student and teacher scores are available.
  2. Clip progress to [0, 1].
  3. Return lambda_0 * (1 - progress).
  4. Record the schedule diagnostics in recovery traces.

Validation

Run:

python scripts/weaning_schedule.py --self-test
python tests/test_weaning_schedule.py

Limitations

The skill only computes coefficients. It does not decide when a teacher query is available or evaluate the RL policy.

我的收藏