sliding-window-attention-adaptation

Adapt full-attention language models to sliding window attention without expensive retraining. Combine five synergistic strategies (full decode, sink tokens, interleaved layers, chain-of-thought, fine-tuning) achieving 30-100% speedups while maintaining 90-100% accuracy.

Independent GitHub snapshot · Automated classification · Original documentation governs