界面已本地化;技能介绍与说明文档按所选语言由 AI 自动翻译,代码、命令、路径和专业术语保留原文,以原作者文档为准。
探索技能
开发与工程 · SKILL.md

pplm_latent_perturbation

pplm_latent_perturbation

【开发与工程】Use when a PPLM-style controller must perturb latent/logit state at inference time with attribute and KL losses while freezing the base model.

独立 GitHub 快照 · 自动分类 · 以原作者文档为准

技能说明

GitHub

name: pplm_latent_perturbation description: Use when a PPLM-style controller must perturb latent/logit state at inference time with attribute and KL losses while freezing the base model.

PPLM Latent Perturbation

Use this skill to implement the core PPLM inference-time update.

Inputs

  • Base next-token logits or latent state.
  • Attribute loss function.
  • Step size, iteration count, KL scale.

Outputs

  • Perturbed probability distribution.
  • Trace with before/after loss, KL, and perturbation values.

Workflow

  1. Copy the base logits/state and keep it immutable.
  2. Initialize a perturbation at zero.
  3. Iteratively estimate the gradient of attribute loss plus KL-to-base penalty.
  4. Update only the perturbation.
  5. Return the final distribution and trace proving the target probability changed.

Validation

Run python tests/test_latent_perturbation.py.

Limitations

Reduced proxy implementations must declare that they are not full GPT-2 345M reproduction.

我的收藏