dmtd-multi-token

Generate multiple tokens simultaneously by having late transformer layers directly predict multiple outputs after early layer processing. No auxiliary parameters or verification needed. Achieve up to 2x generation speedup.

Independent GitHub snapshot · Automated classification · Original documentation governs