Accepted to ICLR 2026 Ringleader ASGD: The First Asynchronous SGD with Optimal Time Complexity under Data Heterogeneity