UI はローカライズ済みです。スキルの紹介と説明文書は選択した言語へ AI が自動翻訳し、コード・コマンド・パス・専門用語は原文のままです。原作者の文書が優先されます。
スキルを探す
生産性・共同作業 · SKILL.md

reward_projection

reward_projection

Project late-specified rewards into backward representation coordinates for immediate FB policy adaptation.

Independent GitHub snapshot · Automated classification · Original documentation governs

スキルの説明

GitHub

name: reward_projection description: Project late-specified rewards into backward representation coordinates for immediate FB policy adaptation.

Reward Projection

Use this skill after an FB backward embedding has been learned and a reward is specified later. It should not update the reward-free embeddings or run new task-specific RL.

Inputs

  • Backward embeddings B indexed by state or goal.
  • Reward observations as {index, reward} records or a sparse goal index.

Outputs

  • Task vector z_R as the weighted sum or average of backward embeddings.
  • Provenance describing which reward entries contributed.

Workflow

  1. Validate that all reward indices exist in B.
  2. Compute z_R = sum_g B(g) r(g) for explicit finite rewards.
  3. Preserve multi-goal rewards by summing their weighted backward vectors.
  4. Return diagnostics and never mutate F or B.

Validation

Run python scripts/project_reward.py --self-test. The test checks sparse and composite rewards.

Limitations

For continuous goals this reduced script expects sampled reward observations rather than integrals over an unknown density.

保存したスキル