zip2zip-adaptive-vocab

Reduce token count by 15-40% at inference through context-adaptive compression, merging frequent token sequences into hypertokens using online Lempel-Ziv-Welch compression without retraining entire models.

Independent GitHub snapshot · Automated classification · Original documentation governs