界面已本地化;技能介绍与说明文档按所选语言由 AI 自动翻译,代码、命令、路径和专业术语保留原文,以原作者文档为准。
探索技能
数据与研究 · SKILL.md

opal_hierarchical_latent_control

opal_hierarchical_latent_control

【数据与研究】Relabel downstream data with OPAL primitive latents and evaluate high-level latent control over temporally extended actions.

独立 GitHub 快照 · 自动分类 · 以原作者文档为准

技能说明

GitHub

name: opal_hierarchical_latent_control description: Relabel downstream data with OPAL primitive latents and evaluate high-level latent control over temporally extended actions.

OPAL Hierarchical Latent Control

When To Use

Use this skill after primitive latents and decoder parameters are available. It tests the OPAL downstream interface: a high-level policy chooses a latent every c steps and the low-level primitive decoder supplies primitive actions.

Inputs

  • Segment JSON and primitive objective output with latent assignments and decoder prototypes.
  • A sparse proxy goal or reward-labeled downstream data.
  • Primitive horizon c.

Outputs

  • Latent-labeled high-level dataset summary.
  • Rollout trace with latent decisions and decoded primitive actions.
  • Success rate and effective horizon.

Workflow

  1. Relabel each segment using encoder/assignment output.
  2. Build a high-level action table in latent space.
  3. Select latents that move toward the goal while staying among learned primitive labels.
  4. Decode each latent for c primitive steps.
  5. Report success and compare latent decisions with primitive action count.

Validation

Run:

python tests/test_hierarchical_control.py

Limitations

The bundled controller is deterministic and intended for reduced proxy recovery. Full offline RL algorithms such as CQL must be integrated separately when available.

我的收藏