vocabtrim-speculative-decoding

Accelerate speculative decoding by pruning drafter vocabulary to high-frequency tokens. Achieves 16% speedup in memory-bound settings by eliminating unused vocabulary entries without retraining.

Independent GitHub snapshot · Automated classification · Original documentation governs