界面已本地化;技能介绍与说明文档按所选语言由 AI 自动翻译,代码、命令、路径和专业术语保留原文,以原作者文档为准。
探索技能
效率与协作 · SKILL.md

block_fisher_rearrangement

block_fisher_rearrangement

【效率与协作】Rearrange binary pruning masks using block-diagonal Fisher interactions while preserving per-layer cardinality.

独立 GitHub 快照 · 自动分类 · 以原作者文档为准

技能说明

GitHub

name: block_fisher_rearrangement description: Rearrange binary pruning masks using block-diagonal Fisher interactions while preserving per-layer cardinality.

Block Fisher Rearrangement

Use this skill after diagonal Fisher mask search has produced binary layer masks. It improves pruning locations within each Transformer layer by using a block Fisher matrix. Do not use it to change the pruning ratio; the paper's rearrangement stage preserves per-layer kept counts and therefore preserves cost.

Inputs

  • A binary mask for each layer.
  • A square Fisher block for each layer.
  • Optional maximum number of greedy passes.

Outputs

  • Rearranged masks with the same cardinality as inputs.
  • Objective values before and after rearrangement.
  • Swap trace.

Workflow

For each layer, score (1-m)^T I (1-m). Try swaps between pruned and kept units and commit only objective-improving swaps. Repeat until no improvement or a pass limit is reached.

Validation

Run the included tests or validate_skill_tree.py --run-tests.

我的收藏