界面已本地化;技能介绍与说明文档按所选语言由 AI 自动翻译,代码、命令、路径和专业术语保留原文,以原作者文档为准。
探索技能
效率与协作 · SKILL.md

least_squares_mask_tuning

least_squares_mask_tuning

【效率与协作】Tune surviving pruning mask coefficients with damped least squares for activation reconstruction.

独立 GitHub 快照 · 自动分类 · 以原作者文档为准

技能说明

GitHub

name: least_squares_mask_tuning description: Tune surviving pruning mask coefficients with damped least squares for activation reconstruction.

Least Squares Mask Tuning

Use this skill for the paper's final post-training pruning stage, after a binary structured mask has been selected and rearranged. It tunes only surviving mask entries to reconstruct original layer activations. Do not use it as model-weight retraining, and never revive pruned entries.

Inputs

  • Matrix A of per-unit activation contributions.
  • Target vector b for reconstruction.
  • Binary keep mask.
  • Damping and acceptable coefficient range.

Outputs

A real-valued mask, baseline/tuned reconstruction errors, and an accepted flag. Pruned entries remain zero.

Workflow

Restrict A to kept columns, solve damped normal equations, insert the coefficients into the full mask, and reject coefficients outside the range. Report whether reconstruction error improved.

Validation

Run the included deterministic synthetic tests.

我的收藏