Two papers have been accepted to NeurIPS 2026: Rescaled Asynchronous SGD: Optimal Distributed Optimization under Data and System Heterogeneity LOSCAR-SGD: Local SGD with Communication-Computation Overlap and Delay-Corrected Sparse Model Averaging