June 25, 2026 DeMo: Decoupled Momentum Optimization 通过解耦动量更新和结构化稀疏化，将分布式训练通信量降低高达85倍 optimizer distributed-training communication-efficiency gradient-compression sparsification momentum
June 25, 2026 DeMo: Decoupled Momentum Optimization 精读文档 分布式训练通信压缩优化器的深度技术分析 optimizer distributed-training communication-efficiency gradient-compression sparsification momentum deep-dive