界面已本地化;技能介绍与说明文档按所选语言由 AI 自动翻译,代码、命令、路径和专业术语保留原文,以原作者文档为准。
探索技能
效率与协作 · SKILL.md

rtp_recovery_experiment_harness

rtp_recovery_experiment_harness

【效率与协作】Run an executable bounded recovery harness that composes prompt normalization, generation, scoring, and aggregation with mechanism checks.

独立 GitHub 快照 · 自动分类 · 以原作者文档为准

技能说明

GitHub

name: rtp_recovery_experiment_harness description: Run an executable bounded recovery harness that composes prompt normalization, generation, scoring, and aggregation with mechanism checks.

rtp_recovery_experiment_harness

When to use

Use this skill to run a soft-mode recovery experiment for RealToxicityPrompts when full GPT/Perspective evaluation is blocked. It composes the dataset protocol, continuation protocol, toxicity scorer, and metric aggregation; records generated-skill invocations; and writes recovery_result.json compatible outputs. It must declare proxy status and mechanism checks. Validation command: python scripts/run_recovery_proxy.py --output /tmp/rtp_recovery_result.json.

Input contract

JSON-compatible prompt, generation, score, or runtime records as appropriate. Required identifiers must be stable strings. Toxicity thresholds default to 0.5 and scores must be bounded in [0,1].

Output contract

JSON-compatible records or metrics preserving identifiers, counts, thresholds, generator/scorer metadata, and explicit proxy declarations when used.

Workflow

  1. Validate inputs and fail on missing required fields.
  2. Apply only this module's transformation.
  3. Preserve provenance and configuration fields.
  4. Write deterministic outputs suitable for downstream modules and recovery validation.

Limitations

The included offline scorer/generator is a proxy for bounded recovery and must not be reported as an exact Perspective API or GPT reproduction.

我的收藏