adaptive-speculative-decoding

Accelerate LLM inference 1.5-2x using a universal draft model that adapts to user data in real-time, handling different target models and tokenizers via online n-gram cache and hybrid distillation.

Independent GitHub snapshot · Automated classification · Original documentation governs