ultramemv2-memory-networks

Scale memory networks to 120B parameters with improved long-context learning through integrated memory layers, simplified value projection, and optimized parameter ratios for superior memory-intensive tasks.

Independent GitHub snapshot · Automated classification · Original documentation governs