界面已本地化;技能介绍与说明文档按所选语言由 AI 自动翻译,代码、命令、路径和专业术语保留原文,以原作者文档为准。
探索技能
效率与协作 · SKILL.md

fb_greedy_policy

fb_greedy_policy

【效率与协作】Extract no-planning greedy policies from FB forward embeddings and a projected reward vector.

独立 GitHub 快照 · 自动分类 · 以原作者文档为准

技能说明

GitHub

name: fb_greedy_policy description: Extract no-planning greedy policies from FB forward embeddings and a projected reward vector.

FB Greedy Policy Extraction

Use this skill when z_R has already been estimated and a policy must be derived by direct FB scoring. Do not use it to plan, search, or update embeddings for the new reward.

Inputs

  • Forward embeddings F indexed as state-action rows.
  • Task vector z_R.
  • Number of states and actions, with deterministic row order state * action_count + action.

Outputs

  • Q-value table F(s,a,z_R)^T z_R.
  • Greedy action for each state with deterministic lowest-index tie breaking.

Workflow

  1. Compute dot products for all state-action rows.
  2. Group scores by state and select the maximum action.
  3. Record ties and avoid any environment planning or reward-specific optimization.
  4. Hand the policy to recovery or evaluation modules.

Validation

Run python scripts/greedy_policy.py --self-test. Tests verify known best actions and deterministic tie handling.

Limitations

The script assumes finite action enumeration and precomputed forward embeddings.

我的收藏