The interface is localized. Skill descriptions and documents are machine-translated by AI into your language; code, commands, paths and technical terms stay in the original, and the author's document governs.
Explore skills
Productivity · SKILL.md

batch-speculative-decoding

batch-speculative-decoding

Fixes batch speculative decoding ragged tensor problem where sequences in batches accept different token counts, desynchronizing state. EQSPEC guarantees output equivalence through proper synchronization. EXSPEC reduces overhead 40% via cross-batch scheduling. Enables efficient parallel decoding with 95% equivalence.

Independent GitHub snapshot · Automated classification · Original documentation governs

Aadu2021 / skillxivNOASSERTION

Skill documentation

GitHub
Loading documentation from the source…
Saved skills