noloco-low-communication-training

【效率与协作】Scale distributed LLM training without all-reduce synchronization using dynamic pipeline routing and modified Nesterov momentum, achieving 4% faster convergence than DiLoCo with exponentially lower communication.

独立 GitHub 快照 · 自动分类 · 以原作者文档为准