UI はローカライズ済みです。スキルの紹介と説明文書は選択した言語へ AI が自動翻訳し、コード・コマンド・パス・専門用語は原文のままです。原作者の文書が優先されます。
スキルを探す
生産性・共同作業 · SKILL.md

stochastic_actor_update

stochastic_actor_update

Run a deterministic SAC-style stochastic actor update with reparameterized Gaussian action, log probability, and policy-gradient diagnostics.

Independent GitHub snapshot · Automated classification · Original documentation governs

スキルの説明

GitHub

name: stochastic_actor_update description: Run a deterministic SAC-style stochastic actor update with reparameterized Gaussian action, log probability, and policy-gradient diagnostics.

Stochastic Actor Update

Use this skill when a recovery needs to exercise the actor component of SAC without depending on a full deep-learning stack. It implements a tiny scalar Gaussian actor with fixed noise so the reparameterized policy loss can be audited deterministically.

Inputs

  • Actor mean and log standard deviation parameters.
  • State feature and deterministic noise sample.
  • A differentiable quadratic Q proxy target.
  • Learning rate.

Outputs

  • Action, log probability, Q value, policy loss.
  • Updated actor parameters and parameter-change evidence.

Workflow

  1. Reparameterize the action as mean * state + exp(log_std) * noise.
  2. Evaluate Gaussian log probability for the noise-scaled action.
  3. Compute SAC policy loss alpha * log_prob - Q(action).
  4. Use analytic gradients for the scalar actor and update parameters.
  5. Record before/after parameters for validation.

Validation

Run python tests/test_actor_update.py or the Distiller skill validator.

Limitations

This is a scalar deterministic proxy for the SAC actor update. It preserves the optimization contract but is not a neural-network policy implementation.

保存したスキル