界面已本地化;技能介绍与说明文档按所选语言由 AI 自动翻译,代码、命令、路径和专业术语保留原文,以原作者文档为准。
探索技能
效率与协作 · SKILL.md

sac_max_entropy_objective

sac_max_entropy_objective

【效率与协作】Compute Soft Actor-Critic maximum-entropy value and actor objective terms for bounded recovery experiments.

独立 GitHub 快照 · 自动分类 · 以原作者文档为准

技能说明

GitHub

name: sac_max_entropy_objective description: Compute Soft Actor-Critic maximum-entropy value and actor objective terms for bounded recovery experiments.

SAC Maximum Entropy Objective

Use this skill when a recovery or implementation task needs the SAC formulas that combine reward-seeking Q-values with policy entropy. Do not use it to manage replay buffers or perform optimizer updates.

Inputs

  • Equal-length numeric lists of Q-values and log policy probabilities.
  • Optional entropy coefficient alpha, defaulting to 1.0.

Outputs

  • Elementwise soft values q - alpha * log_prob.
  • Elementwise actor losses alpha * log_prob - q.
  • Mean summaries for recovery metrics.

Workflow

  1. Validate the input lists are non-empty, equal length, and finite.
  2. Compute soft values with the entropy term included.
  3. Compute policy losses with the same alpha convention.
  4. Save or return the summary for downstream SAC update checks.

Validation

Run python tests/test_objective.py or validate the full skill tree with the Distiller validator.

Limitations

This skill encodes deterministic scalar/list formulas only; full neural policies and temperature tuning belong to a larger training harness.

我的收藏