界面已本地化;技能介绍与说明文档按所选语言由 AI 自动翻译,代码、命令、路径和专业术语保留原文,以原作者文档为准。
探索技能
效率与协作 · SKILL.md

pruning_recovery_evaluation

pruning_recovery_evaluation

【效率与协作】Evaluate Wanda pruning masks for sparsity, no-update invariants, and linear-output reconstruction error.

独立 GitHub 快照 · 自动分类 · 以原作者文档为准

技能说明

GitHub

name: pruning_recovery_evaluation description: Evaluate Wanda pruning masks for sparsity, no-update invariants, and linear-output reconstruction error.

Pruning Recovery Evaluation

Use this skill to validate that a pruning experiment actually applied a mask, left unmasked weights unchanged, and produced numeric output-error evidence. It is suitable for reduced Wanda recovery when full LLM perplexity evaluation is not feasible.

Inputs

  • Original and pruned weight matrices.
  • Evaluation activation matrix shaped examples by input channels.
  • Boolean prune mask.
  • Optional baseline error for comparison.

Outputs

  • Exact sparsity ratio.
  • Relative output error ||XW^T - XW_pruned^T||_2 / ||XW^T||_2.
  • unmasked_weights_unchanged and masked_weights_zero invariant booleans.

Workflow

  1. Check matrix dimensions and mask shape.
  2. Compute dense and pruned linear outputs.
  3. Compute relative reconstruction error with a safe zero-denominator rule.
  4. Verify Wanda's no-update claim: unmasked values must exactly match the original and masked values must be zero.

Validation

Tests cover exact sparsity, unchanged unmasked weights, and a known linear-output error.

Limitations

This skill does not claim full paper reproduction; it supplies mechanism evidence for proxy recovery.

我的收藏