UI はローカライズ済みです。スキルの紹介と説明文書は選択した言語へ AI が自動翻訳し、コード・コマンド・パス・専門用語は原文のままです。原作者の文書が優先されます。
スキルを探す
生産性・共同作業 · SKILL.md

pruning_recovery_evaluation

pruning_recovery_evaluation

Evaluate Wanda pruning masks for sparsity, no-update invariants, and linear-output reconstruction error.

Independent GitHub snapshot · Automated classification · Original documentation governs

スキルの説明

GitHub

name: pruning_recovery_evaluation description: Evaluate Wanda pruning masks for sparsity, no-update invariants, and linear-output reconstruction error.

Pruning Recovery Evaluation

Use this skill to validate that a pruning experiment actually applied a mask, left unmasked weights unchanged, and produced numeric output-error evidence. It is suitable for reduced Wanda recovery when full LLM perplexity evaluation is not feasible.

Inputs

  • Original and pruned weight matrices.
  • Evaluation activation matrix shaped examples by input channels.
  • Boolean prune mask.
  • Optional baseline error for comparison.

Outputs

  • Exact sparsity ratio.
  • Relative output error ||XW^T - XW_pruned^T||_2 / ||XW^T||_2.
  • unmasked_weights_unchanged and masked_weights_zero invariant booleans.

Workflow

  1. Check matrix dimensions and mask shape.
  2. Compute dense and pruned linear outputs.
  3. Compute relative reconstruction error with a safe zero-denominator rule.
  4. Verify Wanda's no-update claim: unmasked values must exactly match the original and masked values must be zero.

Validation

Tests cover exact sparsity, unchanged unmasked weights, and a known linear-output error.

Limitations

This skill does not claim full paper reproduction; it supplies mechanism evidence for proxy recovery.

保存したスキル