界面已本地化;技能介绍与说明文档按所选语言由 AI 自动翻译,代码、命令、路径和专业术语保留原文,以原作者文档为准。
探索技能
效率与协作 · SKILL.md

scaled_lbfgs_solver

scaled_lbfgs_solver

【效率与协作】Run bounded scaled L-BFGS optimization with two-loop directions, memory updates, and backtracking safeguards.

独立 GitHub 快照 · 自动分类 · 以原作者文档为准

技能说明

GitHub

name: scaled_lbfgs_solver description: Run bounded scaled L-BFGS optimization with two-loop directions, memory updates, and backtracking safeguards.

Scaled L-BFGS Solver

Use this skill to recover a small, executable instance of the Liu-Nocedal L-BFGS mechanism. It is appropriate for smooth unconstrained objectives where gradients are available. It is not a replacement for full historical benchmark reproduction.

Inputs

  • Objective function and gradient function.
  • Initial vector, memory limit, iteration count, and tolerance.
  • Optional line-search constants.

Outputs

  • Final parameter vector.
  • Trace containing objective values, gradient norms, step sizes, memory lengths, and scaling values.
  • Mechanism evidence that two-loop recursion, bounded memory, scalar scaling, and optimizer steps ran.

Workflow

  1. Start with empty limited-memory state.
  2. Compute the two-loop direction; fall back to steepest descent if needed.
  3. Backtrack until Armijo decrease holds.
  4. Update parameters and curvature memory.
  5. Log loss, gradient norm, scale, and memory length at each iteration.

Validation

Run python tests/test_scaled_lbfgs_solver.py; the deterministic quadratic test must reduce objective and gradient norm.

Limitations

This skill is a bounded recovery harness component. Full paper-level numerical comparisons require original benchmark definitions that are not available from the resolved page.

我的收藏