界面已本地化;技能介绍与说明文档按所选语言由 AI 自动翻译,代码、命令、路径和专业术语保留原文,以原作者文档为准。
探索技能
效率与协作 · SKILL.md

sac_off_policy_replay

sac_off_policy_replay

【效率与协作】Build and sample validated off-policy replay batches for Soft Actor-Critic recovery harnesses.

独立 GitHub 快照 · 自动分类 · 以原作者文档为准

技能说明

GitHub

name: sac_off_policy_replay description: Build and sample validated off-policy replay batches for Soft Actor-Critic recovery harnesses.

SAC Off-Policy Replay

Use this skill when a SAC experiment needs a compact replay-buffer abstraction that stores transitions and produces deterministic minibatches. Do not compute SAC losses here.

Inputs

  • Transition records containing state, action, reward, next_state, done, and log_prob.
  • Optional integer sample indices.

Outputs

  • A validated replay batch.
  • Summary counts and deterministic sampled transitions.

Workflow

  1. Validate every transition has the required fields.
  2. Convert numeric fields to finite floats and done to bool.
  3. Preserve the stored transition order.
  4. Sample by explicit indices so tests and recovery runs are reproducible.

Validation

Run python tests/test_replay.py or validate the full skill tree with the Distiller validator.

Limitations

This is a bounded recovery utility, not a high-throughput production replay buffer.

我的收藏