界面已本地化;技能介绍与说明文档按所选语言由 AI 自动翻译,代码、命令、路径和专业术语保留原文,以原作者文档为准。
探索技能
数据与研究 · SKILL.md

actor_learner_protocol

actor_learner_protocol

【数据与研究】Validate IMPALA actor learner unrolls with behavior and learner policy metadata for V-trace recovery.

独立 GitHub 快照 · 自动分类 · 以原作者文档为准

技能说明

GitHub

name: actor_learner_protocol description: Validate IMPALA actor learner unrolls with behavior and learner policy metadata for V-trace recovery.

Use this skill when constructing or checking IMPALA-style trajectories before V-trace computation. It should not compute losses or update parameters.

Inputs: rewards, discounts, actions, values including bootstrap, learner policy distributions, and behavior policy distributions. Outputs: validated JSON with action probabilities and policy-lag diagnostics.

Workflow: load an unroll, check dimensions and probability distributions, extract probabilities for each action, and emit a compact validated record. Preserve both learner and behavior policy metadata because treating the sample as on-policy violates the paper mechanism.

Validation: run python tests/test_protocol.py or validate the skill tree with tests. Limitations: this skill uses small JSON fixtures and does not launch distributed actors.

我的收藏