diagonal-batching-recurrent-transformers

Unlocks parallelism in recurrent memory transformers through diagonal batching of the layers-segments grid, achieving 3.3x speedup on 131K-token sequences without model retraining.

Independent GitHub snapshot · Automated classification · Original documentation governs