The interface is localized. Skill descriptions and documents are machine-translated by AI into your language; code, commands, paths and technical terms stay in the original, and the author's document governs.
Explore skills
Productivity · SKILL.md

lora_parameter_budget

lora_parameter_budget

Compute LoRA trainable parameter budgets and reduction ratios for adapted Transformer projections.

Independent GitHub snapshot · Automated classification · Original documentation governs

Skill documentation

GitHub

name: lora_parameter_budget description: Compute LoRA trainable parameter budgets and reduction ratios for adapted Transformer projections.

LoRA Parameter Budget

Use this skill to estimate how many task-specific parameters LoRA trains compared with full fine-tuning.

Inputs

Projection dimensions or d_model, rank r, adapted matrix count, layer count, and optional full-parameter baseline.

Outputs

Trainable LoRA count, dense-update count for the same matrices, and reduction ratios.

Workflow

For square Transformer projections use the paper formula 2 * L_hat * d_model * r, where L_hat counts adapted matrices. Compare against full dense updates L_hat * d_model * d_model.

Validation

Run included tests for formula correctness and rank monotonicity.

Limitations

This is an accounting skill; it does not measure wall-clock training throughput.

Saved skills